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FOREWORD 


This  pro,'9:*am  Involved  the  i’eflneinent  of  natheniatical  models  and 
perfonrance  of  psychophysical  experiments  as  part  of  the  continuation  effort 
of  the  698DF  developnent  project  for  a  high-resolution  low-light-level  tele¬ 
vision  system  for  tactical  airhome  application.  These  studies  have  led  to 
a  better  understanding  of  motion  and  MTF  efi'ects  of  electro-optical  sensors 
and  the  use  of  the  results  can  lead  to  more  realistic  system  specifications 
and  a  reduced  need  for  costly  laboratory  and  flj^t  testing  of  systems. 

The  Air  Force  Project  Director  on  this  program  was  Frank  A,.  McCann, 
AFAIv'NVA(698DF).  The  Westinghouse  effort  was  conducted  principally  by 
Frederick  A.  Rosell  and  Robert  H.  Willson.  The  program  was  performed  by  the 
Westinghouse  Systems  Development  Division,  Baltimore,  Maryland,  u«ier  Air 
Po7'ce  Contract  F336l5-70-C-lil6l. 

This  report  was  submitted  by  Frederick  A.  Rosell  and  Robert  H.  Willson. 

This  technical  report  has  been  reviewed  ani  is  approved  for 
publication. 
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ABSTRACT 


This  effort  is  r  continuation  of  the  Performance  Synthesis  Study, 
Electro-Optical  Sensors  reported  in  Technical  Report  AFA-.  -TR-'7r”229, 
dated  August  1972.  Analytical  models  were  further  de/c^c  " and  refined 
to  include  image  motion  and  aperturing  effects.  P8yc.hopfty%  u  I  experiments 
were  performed  as  tests  of  the  theories  and  it  was  found  th.’:;  'h.  theory  is 
reasonably  accurate.  A  concept  of  balanced  resolution  ie  nl^  <  '  ’  hich 

combines  a  system's  performance  for  both  aperiodic  and  petio.-ic  imagery. 

The  question  of  a  single  figure  of  merit  for  a  system  is  also  discussed. 
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1.0  Introduction  and  Summary 

The  objectives  of  the  Performance  Synthesis  Study  —  Electro- 
Optical  Sensors  —  performed  under  Air  Force  Contract  Number  F33615- 
7O-C-I46I  are  to  determine  the  fundamental  limitations  of  long  range 
air-to-ground  detection,  recognition  and  identification  of  tactical 
military  targets,  to  determine  methods  of  realizing  maximum  range 
performance  through  optimum  spatial,  tenq^oral  and  electrical  filtering 
of  the  received  image  signals  and  to  devise  methods  of  predicting 
maximum  range  performance  taking  into  account  the  parameters  of  real 
targets,  backgrounds,  illumination  sources,  atmospherics  and  sensory 
systems.  The  results  are  to  be  applicjiule  to  all  imaging  sensors 
whether  paissive  or  active  and  are  to  include  low-light-level  television, 
forward-looking  infrared  scanners  and  direct  view  light  amplifiers. 

The  current  effort  is  a  continuation  of  the  programs  previously 
reported  in  Ref.  1  (Technical  Report  AFAL-TR-7I-I37,  May  1971)  and 
Ref.  2  (Technical  Report  AFAL-TR-72-229) .  As  before,  the  approach 
taken  is  to  devise  analytical  models  to  describe  sensory  system 
performance  including  the  observer  as  sn  integral  part  of  the  system. 
Psychophysical  experiments  are  performed  to  obtain  the  necessaiy 
constants  of  the  observers  to  quantitatively  evaluate  the  analytical 
models.  Through  these  efforts,  it  is  hoped  to  promote  a  better  under¬ 
standing  of  the  operation  of  electro-optical  sensors,  guide  the  further 
development  of  systems  conqjonents,  improve  methods  of  sensory  system 
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performance  and  reduce  the  necessity  of  costly  laboratory  and  flight 
evaluation  of  prototype  systems. 

In  the  previous  efforts  reported,  the  early  emphasis  in 
analysis  and  experimentation  was  on  images  of  simple  or  regular  geometry 
such  as  rectangles  and  bar  patterns.  Real  images  of  tactical  objects 
were  also  considered  with  *'  concerted  effort  to  correlate  the 
discemability  of  bar  patterns  with  various  levels  of  real  object 
discrimination  —  particularly  real  object  recognition  and  identification. 
Some  success  witn  the  equivalent  bar  pattern  approach  was  realized  as 
noted  in  Ref.  2.  However,  fiirther  efforts  were,  and  still  are,  required. 

The  discernability  of  an  image  projected  onto  the  photosurface 
of  an  electro-optical  sensor  and  ultimately  displayed  to  an  observer 
is  limited  by  the  sensor's  sensitivity  to  the  received  radiation  and  by 
noises  generated  either  in  the  primary  photoconversion  process  or  in  sub¬ 
sequent  signal  processing.  Also,  the  image's  discemability  is  limited 
by  finite  sensor  apertures  that  decrease  the  image  modulation.  Pre¬ 
liminary  efforts  to  account  for  the  effects  of  these  apertures  were 
reported  in  Ref.  1.  The  theory,  then  presented,  though  leading  to 
reasonable  system  predictions  was  intuitively  unsatisfying.  An  advanced 
theory  was  presented  in  Ref.  2  that  was  more  satisfying  but  still  had 
deficiencies  —  particularly  in  the  treatment  of  aperiodic  (rectangular) 
images. 

Concurrent  with  the  effort  reported  Ref.  2,  a  separate 
effort  was  undertaken  under  Air  Force  Contract  Number  F3?6l5-70-C-H6l  by 
Sendall  ar-d  Resell  to  analyze  lUR  and  TV  on  a  common  basis.  In  this 
program,  the  aperiodic  image  treatmvent  was  consd.derab'ty  improved  due  in 


large  part  to  Sendall.  These  advances  in  the  modeling  are  reported  herein 
in  some  detail.  While  much  of  the  ground  work  for  the  present  models  must 
be  attributed  to  Otto  Schade,  Sr.,  the  translation  of  the  theory  to 
practice  has  not  proved  trivial. 

The  performance  synthesis  program  as  presently  constituted  is 
a  relatively  small  program.  Specifically,  it  involves  the  part  time 
efforts  of  the  authors  and  the  not  inconsiderable  efforts  of  many 
motivated  and  dedicated  Westinghouse  engineers  who  volunteer  their  efforts 
in  the  tedious  psychophysical  experimentation. 

In  each  of  the  continuation  efforts,  there  has  been  an  effort 
to  focus  on  the  most  critical  problems  involved  in  the  image  discrimination 
task.  In  this  most  recent  effort,  we  have  elected  to  concentrate  on  the 
areas  of  image  aperture  effects  and  image  motion  which  are  closely 
allied  problems. 

In  the  early  days  of  airborne  television,  wide  fields  of  view 
were  the  inile.  Typically,  viewfields  were  30°  x  40°  which  are  comparable 
within  a  factor  of  2,  to  the  viewfield  of  the  unaided  eye.  Scene 
resolution  observed  on  the  display  was  also  comparable  to  that  which 
could  be  observed  by  the  unaided  eye  in  the  daytime.  With  passage  of 
time,  viewfields  have  become  ever  narrower,  with  fields  of  view  as 
small  or  smaller  than  1°  becoming  usual.  Under  many  conditions,  the  TV 
augmented  observer's  resolution  of  scene  detail  substantially  exceeds 
that  which  he  can  resolve  directly.  While  narrower  fields  of  view 
have  led  to  longer  scene  object  detection  ranges,  range  cannot  be  extended 
indefinitely  by  simply  reducing  viewfield.  In  the  more  modem  systenas, 
the  resolution  of  scene  detail  is  limited  not  by  the  lens  or  TV  camera. 
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but  by  sightline  instability.  In  TV  practice,  the  effect  of  sightline 
instcbility  is  to  blur  the  image  during  the  TV  image  exposure  time. 

These  sightline  instability  effects  are  analytically  considered  in  some 
detail  In  Section  2.  Psychophysical  experiments  \ising  moving  images  were 
performed  and  the  results  are  reported  in  Section  4»  In  the  psycho¬ 
physical  experimentation,  recognition  experiments  were  performed  using 
images  moving  laterally  across  the  field  of  view.  The  primary  effect 
of  the  motion  was  to  degrade  resolution  in  the  horizontal  leaving  the 
vertical  unchanged  (except  for  some  vibration  induced  in  the  camera 
sightline  due  to  the  motion  apparatus) .  Efforts  were  made  to  model 
the  motion  effects.  Some  apparent  success  is  noted  but  the  efforts  must 
be  considered  preliminary.  Moving  image  experiments  represent 
a  high  level  of  difficulty.  In  any  given  experiment,  it  is  difficult 
to  separate  the  effects  of  motion  interacting  with  the  exposure  time 
from  the  effects  of  motion  on  sensor  lag.  Also,  it  is  difficult  to 
both  define  and  measure  signal  levels  using  complex  imagery.  However, 
the  initial  efforts  reported  herein  are  essential  to  obtain  a  feel 
for  the  magnitude  of  the  problems  involved  and  to  form  a  base  for 
further  effort. 

To  lay  the  groundwork  for  the  modulation  transfer  function 
experiments,  we  develop  the  theory  of  apertures  in  great  detail  in 
Section  3.  Ihis  includes  the  latest  treatment  of  the  effects  of  apertures 
on  aperiodic  images.  In  the  evolution  of  the  sensor  models,  aperiodic 
and  periodic  images  are  separately  treated.  Using  these  models,  it  is 
found  that  simple  aperiodic  images  can  be  detected  at  much  longer  ranges 
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than  periodic  iiaages  both  in  principle  and  in  practice.  Preliminary 
efforto  were  made  to  develop  a  "balanced”  resolution  concept  as 
discussed  in  Section  2.  The  balanced  resolution  concept  is  felt  to 
have  merit  when  based  on  the  average  angulai’  scene  resolution  (rather 
than  the  average  limiting  resolution  based  on  threshold  spatial  frequency) . 
The  preferred  averaging  technique  weights  the  periodic  model  more 
heavily  which  is  felt  to  be  in  the  right  direction. 

The  detailed  theory  of  apertures  developed  in  Section  3  is 
used  to  update  the  model  of  Section  2  and,  as  *^e  noted,  to  serve  as  a 
foundation  for  the  MTF  related  psychophysical  experimentation  having  to 
do  with  both  image  motion  and  fixed  sensor  apertures.  The  theory  of  the 
effect  of  apertiires  is  well  developed  and  mathematically  rigorous. 

However,  the  observer  is  an  integral  part  of  the  system  and  the  mathe¬ 
matical  rigor  must  therefore  include  the  hjmar.  element  and  thus  the 
theory  must  be  confirmed  through  psychophysical  experiments.  To  our 
knowledge,  experiments  to  confirm  the  theory  have  not  been  performed 
except  to  show  first  order  effects. 

The  psychophysical  experimentation  reported  in  Section  5  is 
devoted  to  modulation  transfer  function  effects.  Different  MTF 
characteristics  were  obtained  by  defocusing  of  the  cameras  objective 
lens.  Specified  in  terms  of  Schade's  noise  equivalent  passband,  N., 
the  best  MTF  had  an  N  of  252  and  the  poorest  had  an  N  of  69.  The 
experiments  made  with  constant  aspect  and  constant  length  bar 
patterns  appear  to  indicate  that  the  current  theory  yields  results 
that  are  somewhat  pessimistic  for  MTF's  with  low  N  (poor  MTF). 

Experiments  v/ith  isolated  bars  and  cjjcles  indicate  that  the  theory 
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correctly  accounts  for  the  MTF  effects.  Uoi:je  images  of  real  objects 
(vehicles),  it  was  found  that  the  results  predicted  on  the  basis  of 
theory  are  again  pessimistic  but  to  a  lesser  extent  than  that  predicted 
for  the  periodic  patterns.  The  periodic  theory  of  apertures  thus 
appears  to  need  further  work. 

For  many  years,  researchers  in  the  optical  field  have  sought 
a  single  unit  figure  of  merit  for  sensory  systems.  Whether  such  a 
unit  has  much  in  the  way  of  practical  merit  is  open  to  debate  but  in  the 
quest,  a  better  understanding  of  the  parameters  that  determine  image 
quality  should  evolve.  In  Section  6,  a  number  of  the  figures  of  merit 
previously  proposed  are  reviewed.  Most  of  the  figures  of  merit  Involve 
some  integral  of  the  modulation  transfer  function  or  equivalently,  the 
integral  of  the  point  spread  function.  A  primary  difference  between 
various  measures  is  the  weight  applied  to  the  functions  before  integrating. 

Most  of  the  figures  of  merit  do  no’/  include  sensitivity  or  sig- 
nal-to'-noise  as  a  parameter.  Thus  a  sensor  with  a  very  high  figure  of  merit 
may  be  far  inferior  to  one  with  a  low  figure  in  a  given  application. 

For  example,  a  very  high  resolution  vidicon  would  be  inferior  to  a  low 
resolution  LLLTV  when  a  night  scene  is  +<o  be  viewed.  When  signal-to- 
noise  ratio  is  included  as  a  parameter,  the  figure  of  merit  usually 
ceases  to  be  a  single  number  but  rather,  becomes  a  function.  In  recent 
work,  attempts  have  been  made  to  include  sensitivity  and  noise  in 
the  figure  of  merit.  The  concept  is  to  integrate  the  area  between 
the  signal  curve  and  the  noise  curve  (with  signals  and  noises  e>q)ressed 
as  a  function  of  spatial  frequency) .  Tliie  principal  deficiency  of 
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this  scheme  j.s  the  problem  of  selecting  the  low  frequency  limit. 

It  is  clear  that  finding  a  single  figure  of  merit  for  a  sensory 
system  is  higlily  unlikely.  The  figure  of  merit  will  undoubtedly  be  a 
function  and  will  ixiclude  both  sensitivity  and  resol:ition  parameters. 

The  threshold  resolution  vs  photosurface  irradiance  characteristic 
of  a  sensor,  used  extensively  by  television  designers,  is  a  figure- 
of -merit  function  based  on  bar  pattern  inputs.  This  characteristic 
includes  the  sensor  sensitivity,  MTF  and  noise  parameters  but  the 
characteristic  may  not  be  in  the  most  useful  form  and  it  has  not  been 
related  to  a  picture  quality  criterion.  A  figure  of  merit  based  on 
the  threshold  resolution  characteristic  has  been  proposed  by  Schade 
and  will  be  discussed  in  the  follow-on  efforts . 
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2.0  Range  Analysis  and  Model  Update 

In  this  section,  we  shall  review  the  efforts  made  during  the 
current  program  to  improve  the  analytical  electro-optical-sensor-augmented 
observer  model  and  show  the  practical  application  of  the  model  to  imaging 
systems.  In  Section  2.1,  the  sensor  model  and  observer  requirements, 
as  previously  reported  in  Refs.  1  and  2  and  updated  in  this  report,  are 
discussed.  The  model  is  applied  to  a  passive  electro-optical  imaging 
system  in  Section  2.2  and  to  an  active  electro-optical  imaging  system  in 
Section  2.3.  In  these  sections,  the  scene  is  assumed  to  be  stationary 
relative  to  the  sensor.  In  Section  2.4,  the  effects  of  relative  image 
motion  on  overall  system  performance  will  be  taken  into  account  to  the 
extent  that  these  effects  are  now  understood.  In  all  of  these  analyses, 
the  emphasis  is  in  determining  the  range  at  which  specific  scene  objects 
can  be  detected,  recognized  and  identified  under  varying  scene  and  atmospher¬ 
ic  conditions.  In  Section  2.5,  i  balanced  resolution  concept  is  diacuased. 
2.1  The  Sensor  Model  and  Observer’ Requirements 

The  analysis  and  experimentation  discussed  in  this  report  and  the  two 
which  preceded  it  are  based  on  the  concept  that  signal-to-noise  ratio  can 
be  associated  with  a  scene  object  after  it  has  been  imaged  by  a  lens  and 
phototransduced  by  a  photosensitive  surface.  The  image  is  then  further 
processed  by  the  electro-optical  system.  In  this  processing,  signal-to- 
noise  ratio  is  lost.  Knowing  the  system  parameters,  the  amount  lost  can 
be  readily  calculated  for  Images  of  simple  or  regular  geometric  shape. 
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Eventually,  the  sensor  recreates  a  visible  light  image  on  a  display 
vihich  may  be  directly  viewed  by  an  observer.  With  good  design,  the 
electro-optical  sensor  displays  the  image  with  sufficient  size  and 
luminance  to  insure  that  the  observer  will  not  be  acuity  or  light-level 
limited.  If  this  is  the  case,  the  system  f'stermines  the  image  signal- 
to-noise  ratio  and  not  the  observer's  eye  except  that,  due  account  must 
be  taken  of  the  ability  of  the  observer  to  integrate  over  the  area  of 
the  image  and  to  integrate  over  a  period  of  time. 

In  the  elementary  sensory  system  model  reviewed  in  Section  3 .1, 
it  is  assumed  that  the  displayed  image  is  signal  limited  by  the  image's 
size  and  irradiance  level  and  further  limited  by  noises  generated  either  in 
the  scene  photon-to-senscr-photoelectron  conversion  process  or  by  the 
system  itself.  Then,  it  is  shown  that  the  image's  discernability  can  be 
further  reduced  by  the  sensor's  finite  apertures.  By  finite  apertures,  we 
mean  those  elements  or  processes  in  the  sensor  which  cause  a  blurring  of 
the  image.  In  an  ideal  sensor,  a  point  object  v/ould  be  imaged  as  a  point 
on  the  display.  In  a  real  system,  the  lens  causes  the  point  to  become 
a  blxir  circle  in  the  image  plane  due  to  diffraction,  lack  of  focus  and 
aberration  effects.  The  image  may  then  be  further  blurred  by  fiber-optic 
faceplates,  electron  lens  defects,  phosphor  particles,  lateral  spread 
iii  charge  storage  targets  and  the  finite  diameters  of  electron  beams. 

Some  blurring  effects  are  intentionally  introduced.  For  example,  the 
horizontal  resolution  in  a  TV  camera  may  be  video  bandwidth  limited  and  the 
display  beam  may  be  intentionally  defocused  in  the  vertical  to  minimize 
the  raster  structure.  These  blurring  effects  on  the  image  are  quantita¬ 
tively  described  in  terms  of  the  optical  transfer  functions  of  individual 
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system  elements  and  are  taken  into  accovsnt  in  analyzing  the  image 
signal-toHioise  ratios. 

The  observer  is  an  integral  part  of  a  real  time  imaging  system  and 
the  system's  overall  performance  must  take  the  observer's  requirements 
into  account.  For  simplicity,  vre  divide  the  total  imaging  problem 
into  three  parts  which  are:  the  properties  of  the  scene,  the  capability 
of  the  imaging  system  and  th'  requirements  of  the  observers.  The 
ability  of  the  observer  to  resolve  imaged  scene  detail  is  determined  by 
matching  the  signal-to-noise  ratio  of  an  image  appearing  on  the  output 
of  the  electro-optical  sensor's  display  to  that  required  by  the 
observer  to  discern  the  image  at  a  given  level  of  detail. 

The  properties  of  the  scene  will  be  discussed  in  the  next  two 
sections.  In  this  section,  we  will  concentrate  on  the  sensor  and 
observer  requirements.  We  note  first  that  the  lens  images  the  scene 
on  the  input  photoswface  which  converts  the  scene  photons  to  photo- 
electrons.  The  rate  at  which  the  photoelectrons  are  generated  can  be 
described  in  terms  of  a  current,  i.  In  the  development  of  the 
elementary  model,  it  was  found  that  the  signal-to-noise  ratio  of  an  image 
appearing  on  the  display  of  a  typical  television  camera  could  be  written 


SMiin=  - r 

+  Ip 


where  t  is  the  integration  time  of  the  observer's  eye,  a  is  the  image 
area,  a  is  the  picture  aspect  ratio  (W:H),  A  is  the  total  effective 


11 


photosurface  area,  is  the  image  modulation  contrast,  G  is  the  pre¬ 
storage  gain  of  the  TV  camera  tubes  gain  storage  target,  i^^  is  the 

2 

average  photocurrent,  e  is  the  charge  of  an  electron.  Ip  is  the  mean 
square  system  (preanqalifier)  noise  added  subsequent  to  the  readout  of  the 
image  by  the  electron  beam  and  Afy  is  the  "/ideo  bandwidth.  In  deriving 
the  above  equation,  it  was  assumed  that  the  image  area,  a,  is  large 
relative  to  the  overall  system  blur  circle,  that  the  photoelectron  image 


is  amplified  by  an  amoui'l,  G,  before  being  stored  and  read  out,  and  that 
the  only  sources  of  noise  are  the  photoelectron  noise  and  the  preamp 
noise,  both  of  which  are  white  in  character.  When  the  above  conditions 
prevail,  the  above  equation  applies  equally  well  to  the  detection  of 
simple  geometric  shapes  such  as  squares  or  rectangles  find  to  bar  patterns. 
Fo”  squares  or  rectangles,  a  is  the  area  of  the  square  or  rectangle  while 
for  bar  patterns,  a  is  the  area  of  a  single  bar.  The  areas,  a,  have  some 
restrictions  but  these  restrictions  can  generally  be  neglected  for  the 
usual  class  of  imaging  tasks. 

Simple  rectangular  objects  against  a  uniform  background  are 
designated  as  aperiodic  objects  while  a  bar  pattern  is  designated  as  a 
periodic  object  in  the  direction  transverse  to  the  bars.  Whether  periodic 
or  aperiodic,  it  is  often  an  analytical  convenience  to  describe  the 
dimensions  of  the  object's  image  in  terms  of  dimensionless  reciprocals, 
i.e.,  if  the  image  dimensions  are  Ax  by  Ay  and  if  the  image  plane 
height  is  Y,  then  we  define 


Cw=(i  -i.)/(i  fi.)' 

M  max  nun  '  max  min 
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(2) 


Y  lines 

Ax  picture  height  * 


1  Ay  eAx  e  * 


(3) 


where  e  is  equal  to  the  ratio  Ay/Ax,  The  quantity  N,  when  used  to  describe 
a  bar  pattern  has  the  form  of  a  spatial  frequency  which  is  a  convenience 
when  performing  Fourier  ana!*'  the  image  in  the  frequency  domain. 

With  Eqs.  (2  and  . 


SNRjj 


(4) 


In  the  above,  the  ima^fe  ic  a  function  of  x  and  y.  In  the  following,  we 
will  assume  that  the  x  and  y  variables  of  the  image,  and  of  the  apertures 
which  blur  the  image  ai'e  independent  and  separable  so  that  the  images 
can  be  independently  analysed  in  he  x  and  y  directions. 

Suppose  that  the  imai’ing  system  has  two  principal  apertures,  the  lens 
and  t  ’■ .  camera  tube '  s  gain  storage  target .  Let  the  modulus  of  the  lens ' 
optical  transfer  function  be  and  that  of  the  target  be  iR^^(N)i  . 

The  quantities  •Rql(N)i  and  iRqy(N)'  are  known  as  the  modulation  transfer 
functions  or  MTFs.  The  lens  MTF  precedes  the  point  of  photoelectron 
noise  insertion  (at  the  photosurface)  while  the  target  follows  the  point 
of  photoelectron  noise  insertion  but  precedes  the  point  of  preamplifier 
noise  insertion  as  shown  in  Fig.  1. 
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Gain  Storage 
Target 


SotC) 


J  oint  of  Photoe3.ectron 
Noise  Insertion 


Point  of  Preamp 
Noise  Insertion 


Fig.  1  Location  of  Points  of  Noise  Insertion  Relative  to  the  MTFs. 


If  the  input  image  is  aperiodic,  both  the  lens  and  target  MTFs  will 
increase  the  noise  perceived  by  the  observer.  However,  the  magnitude 
of  the  increase  depends  upon  the  location  of  the  MTF  relative  to  the  point 
of  noise  insertion.  The  lens  increases  the  photoelectron  and  the  preamp 
noises  by  the  same  factor  since  it  precedes  both  noise  insertion  points. 
However,  the  target  filters  or  bandlimits  the  photoelectron  noise  since 
it  follows  its  point  of  noise  insertion.  Thus,  the  target  MTF  has  a 
relatively  greater  effect  on  the  preamp  noise  than  on  the  photoelectron 
noise . 

The  noise  increase  factor  for  aperiodic  iniages  is  given 
approximately  by 


^xLT  •  VlT 


-  >  ■  i»!  '  'o 


1  ^  (!L)2  ^  ~ 


where  and  Ay^  are  in  units  of  picture  heights  and,  and  6,j,  are  the 
noise  equivalent  apertiires  defined  by  the  equations 


“  N 


/"lRoi,(N)l 


“  N 


r'v«' 


Note  that  by  Eqs.  (2,  3,  6  and  j),  Eq.  (5)  may  be  written  in  the 
equivalent  form 


N  v2  ,  /  N 


e  £  _  fi  X  (’JL^2  ^  / JL'iS  r  fi  X  f  N  >,2  ^  /  N  .zl 

VlT  ‘  J  L  '"el  '"el  J 


In  the  above,  it  is  assumed  that  the  sensor  MTF  is  the  same  in  both  the 
X  and  y  directions.  The  filtering  effect  of  the  target  on  the  photo¬ 
electron  noise  is  given  by 


^xTr*  V  “ 


^xLT*te 


or  equival-ontly. 


^  ^  1  X  N  'iZ  ,  5/  N  n2  ^ 

1  +  (m— )  +  2(rj-~;  •  1 

L  ^^eL  ‘^eT  J  . 


®NeL  j 


.  (10) 
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These  reiixLts  are  incorj’orated  into  the  Eq.  (4),  as  follows 
o.n,  rte.i.  1  ^Vl^av _ 


SNRp  =  i — T - JLlav - ^ 

^  ^  L  V  r  i  till 

4  ^2Af„ 


As  we  discussed  above,  the  noise  increase  factors  affect  the  photo¬ 
electron  noise  and  the  preamp  noise  equally  but  the  target  exerts  a 
filtering  action  on  the  photoelectron  noise.  We  note,  however,  that  the 
target  increases  the  perceived  photoelectron  noise  more  than  it 
filters  it. 

A  bar  pattern  is  periodic  in  one  direction  and  aperiodic  in  the 
other.  Assume  that  the  bar  pattern  is  periodic  in  the  x  direction. 

In  the  periodic  x  direction,  ;;he  primary  effect  of  the  lens  and  target  will 
be  to  decrease  the  signal  modulation  and  leave  noise  unchanged.  However,  as 
before,  the  target  will  exert  a  filtering  effect  on  the  photoelectron  noise. 
The  decrease  in  signal  modulation  is  given  by  the  square  wave  flux 
factor,  Rgp(N) .  The  square  wave  flux  factor  is  related  to  the  overaD.l 
system  MTF,  IR^gCN)!,  by  the  formula. 


Rgp(N)  = 


8  „ 


,  for  k  odd. 


The  purpose  of  this  calculation  is  to  convert  the  signal  ■waveform  to  a 
mean  signal,  i.e.,  SNRjj  is  proportional  to  the  mean  signal-to-nn.s  noise 
ratio  not  the  peak-to-peak  or  rms  signal. 

The  targets  filtering  action  on  the  photoelectron  noise  in  the 
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periodic  direction  is  gi.ven  by 


.N  IR  „(N)I^ 


Using  Eqs.  (12  and  13)  in  Eq.  (4),  we  obtain 

SNHj  =  j  . 

N  ®^yT^3d'^av 

In  the  above,  we  have  observed  that  the  image  is  aperiodic  in  the  y 
direction  so  that  the  noise  increase  factor  is 

t  n  /  N  \2  /  N  \ 2 

^vT.T  =  [1  +  )  ]  > 


and  the  noise  filtering  factor  is 


f  ’ 


for  the  y  direction.  Ordinarily,  the  bars  in  the  pattern  ai'e  quj.te 
long  (e  »  l)  relative  to  their  spacing  so  that  the  noise  increase  and 
filtering  factors  in  the  y  direction  can  be  neglected  (but  not  always) . 

The  Eqs,  (11  and  14)  are  used  to  determine  the  image  signal-to~noise 
ratio  obtainable  from  the  sensor  for  Images  of  siiiqjle  or  regular 
geometry.  In  the  previous  effort  (Ref.  2),  it  was  postulated  that  the 
detectability  of  these  simple  geometric  images  could  be  correlated  with 
the  detectability,  recognizability  and  identifiability  of  real  images 
by  suitably  selecting  an  equivalent  simple  image. 
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a)  Input  Image 


b)  Video  Output  Waveform 


Fig.  2  Video  Outpvit  Waveforms  for  a  Single  Isolated  Bar  and  a  Repetitive 
Bar  Pattern. 


In  Fig.  2a,  an  isolated  single  bar  is  shown  along  with  a  bar  pattern. 

The  width  of  the  single  bar  is  equal  to  the  width  of  the  bars  or  spaces  in 

the  bar  pattern.  The  expected  waveform  of  the  images  traverse  to  their 
width  is  shown  as  they  might  appear  in  the  video  chaniael  in  Fig.  2b. 
Although  the  irradiance  level  of  the  single  bai’  is  the  same  as  for  the  bar 

pattera,  the  incremental  signal,  Ai,  is  larger  for  the  single  bar  than 

for  bars  within  the  bar  pattern  due  to  the  sensor's  modulation  transfer 
function.  We  have  postulated  in  the  past,  that  an  observer,  ii; 
detecting  the  presence  of  a  bar  pattern,  must  detect  the  presence  of  a 
single  bar  in  the  bar  pattern.  We  have  found  that  this  postulate  is 
reasonable  and  that  the  signal-to-noise  ratio  needed  by  the  observer  to 
detect  the  presence  of  an  isolated  bar  is  approximately  the  same  as 
the  signal-to-noise  ratio  needed  to  detect  the  bar  in  the  bar  pattern. 


However,  as  was  illustrated  in  Fig.  2,  the  signal  obtainable  from  the 
sensor  is  larger  for  the  isolated  bar  than  it  was  for  the  bar  in  the 
bar  pattern. 

Thus,  the  SNRjj  as  calculated  using  aperiodic  objects  using  Eq.  (11) 
can  be  expected  to  be  larger  than  the  SNRjj  using  Eq.  (14).  This  will  be 
of  consequence  as  we  attempt  to  correlate  the  detectability  of  real  scene 
object  with  the  detectability  of  simple  geometric  test  objects. 

A  real  scene  hardly  ever  consists  of  periodic  or  isolated  aperiodic 
objects.  An  example  of  an  isolated  aperiodic  object  is  an  aircraft  imaged 
against  a  clear  sky  background.  A  recently  plowed  or  cultivated  field 
might  qualify  as  a  periodic  scene  object.  When  the  object  qualifies  as 
an  isolated  aperiodic  object,  the  Eq.  (11)  is  directly  applicable  and 
similarly  the  Eq.  (14)  qualifies  when  the  scene  is  periodic.  In  genenal, 
specific  scene  objects  are  neither  periodic  or  aperiodic  (in  the  sense 
that  we  are  using  aperiodic)  but  somewhere  in  between.  In  the  fore¬ 
going  paragraph,  we  observed  that  SNRj^  calculated  on  the  basis  of  an 
aperiodic  object  will  be  largsr  than  the  SNRjj  calculated  for  a  periodic 
object .  In  turn,  we  will  see  that  system  "resolution''  will  be  highesr 
for  the  aperiodic  object  than  for  the  periodic  object  when  resolution  is 
specified  in  terms  of  the  smallest  bar  width  that  can  be  discenied. 

In  the  previous  effort  (Ref.  2),  it  was  proposed  that  levels  of  object 
discrimination,  i.e.,  detection,  orientation,  recognition  and  identifica¬ 
tion  be  established  along  the  lines  suggested  by  Johnson  (Ref.  3).  In 
this  scheme,  u  scone  object  is  replaced  by  an  equivalent  bar  pui-tem. 

The  bar  pattern  was  to  be  constructed  with  bar  length  equal  to  the 
length  of  the  object  and  with  bar  widths  equal,  to  the  object's  minimum 
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dimension  divided  by  a  factor  k^.  The  factor  is  small  for  low 
levels  of  object  discrimination  such  as  simple  detection  or  orientation 
and  larger  for  high  levels  of  discrimination  such  as  recognition  or 
identification.  The  definitions  of  the  levels  of  discrimination  are  given 
in  Table  1  and  the  discrimination  factors,  k^,  are  tabulated  in  Table  2. 

The  principal  discrimination  levels  are  detection,  recognition  and 
identification.  The  equivalent  bar  patterns  corresponding  to  these 
discrimination  levels  are  illustrated  schematically  in  Fig.  3  and  the 
geometric  relations  from  a  systems  viewpoint  for  the  identification  case 
are  illustrated  in  Fig.  4. 

We  note  that  the  replacement  of  an  object  by  an  equivalent  bar  pattern 
for  the  detection  case  involves  substantial  changes  in  the  detection 
concept.  For  an  aperiodic  object,  the  SNRjj  is  based  on  the  total  area 
of  the  object's  image.  With  the  equivalent  bar  pattern  notion,  the 
SNRp  is  calculated  on  the  basis  of  1/2  the  area.  Secondly,  for  an 
aperiodic  object,  the  SNRj^  is  calculated  using  Eq.  (ll)  while  with  the 
equivalent  bar  pattern  approach,  is  calculated  using  Eq.  (14). 

Again,  we  note  that  even  for  objects  of  the  same  image  area,  SNRp 
calculated  on  the  basis  of  Eq.  (ll)  wiLl  be  higher  than  S^]RQ  calculated 
on  the  basis  of  Eq.  (14).  Or.  the  other  hand,  the  isolated  aperiodic 
case,  while  it  does  occur,  is  unrealistic  when  used  to  predict  the 
detectability  of  the  usual  terrestrial  object  amid  a  low  to  moderately 
cluttered  baclcground.  When  objects  in  severe  clutter  are  to  be  detected; 
resolution  calculated  even  on  the  basis  of  Eq.  (14)  for  the  periodic 
pattern  may  be  too  high.  For  some  situations,  it  may  be  necessary 
to  recognize  an  object  to  detect  it. 


Classification  of 
Discrimination  Level 

Detection 

Orientation 

Recognition 

Identification 


Meaning 

An  object  is  present. 

The  object  is  approximately  synmetrical  or 
tmsymmetrical  and  its  orientation  may  be 
discerned . 

The  class  to  which  the  object  belongs  may 
be  discerned  (e.g.,  house,  truck,  man,  etc.). 

The  target  can  be  described  to  the  limit  of 
the  observer's  knowledge  (e.g.,  motel,  pick¬ 
up  truck,  policeman,  etc .) . 


Table  1  Levels  of  Object  Discrimination. 


Discriminati.on  Level 

Discrimination  J^evel 
Detection 

Ca’ientaticn 

Recognition 

Idertificatd.on 


Discri'inination  Factor,  k., 
in  terms  of  the  Kurriber  of  Resolution 
Iiines  .'Req.uired  per  Minimum  Object 
_ Dimension  (TV  Lines) 


2.0 


+  1.0 

-  0.5 


2  3 

-  0.4 


8.0 

12,. 8 


+  1.6 

-  0.4 

+  3«2 

-  2.8 


Table  2  Johr.son's  Crit-^ria  for  the  Resolution  Required  per  Minimum  Object 
Dimension  vs  Discrliidnabion  I-evel. 
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For  the  recognition  case,  vre  face  a  dilemma  similar  to  the  detection 
case.  To  recognize  an  object,  it  is  probable  that  the  objects  outline 
must  be  discerned  with  a  fairly  high  degree  of  clarity.  However,  the 
outline  is  by  no  means  periodic  but  the  prediction  of  an  object's 
recognizability  and  identifiability  of  real  scene  objects,  such  as 
vehicles  were  correlated  with  the  detectability  of  an  equivalent  bar 
pattern.  The  correlation,  based  on  the  threshold  SNU^  required  by  the 
observer  appeared  surprisingly  good  and  perhaps  too  good  because  of  a 
difference  in  the  method  of  calculating  signal  as  we  noted  at  the 
time.  In  the  case  of  the  real  object,  we  calculated  the  threshold 
signal-to-noise  ratio  on  the  basis  of  the  peak  signal  excursion  above 
(or  below)  background  while  for  the  equivalent  bar  pattern,  we  used 
the  signal  excursion  within  the  bar  pattern  structure  as  noted  in 
Fig.  2b.  Had  we  calculated  SNRp  for  the  real  object  on  the  basis  of  the 
mean  signal  excursion  rather  than  the  peak  signal  above  background, 
the  SNRjj  at  threshold  would  have  been  smaller  for  the  real  object. 

When  the  visual  task  is  to  detect  a  truly  aperiodic  object, 
such  a  water  tower  against  the  horizon  sky,  the  analysis  is  clear 
cut,  as  noted  before.  The  aperiodic  Eq.  (U.)  is  used.  For  more  complex 
scenes  or  levels  of  discrimination  we  suggested  jji  Ref.  2,  as  a  possible 
compromise,  a  dual  resolution  criterion  wherein  the  resolution  is  first 
calculated  on  the  basis  of  an  aperiodic  object  and  then  on  the  basis 
of  a  periodic  object.  Tne  overall  system  resolution  is  then  estimated 
to  be  the  arithmetic  average  of  the  periodic  and  aperiodic  object  resolu¬ 
tion.  It  is  tentatively  proposed  that  the  total  object  areas  are  to  be 
chosen  in  the  followinj'  manner.  Suppose  the  equivalent  scene  object 
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is  a  rectangle  of  area  equal  to  the  area  of  the  real  object,  of 
vfidth  approximatsly  equal  to  the  object's  minimum  dimension  and  of  length 
approximately  equal  to  the  area  of  the  real  object ' s  area  divided  by 
its  vridth. 

However,  the  SNRjj,  and  in  turn,  the  resolution,  is  calculated  for 
an  area  equal  to  the  width  of  the  equivalent  area  divided  by  the  discri~ 
mination  factor  of  Table  2.  For  detection,  in  a  moderately  cluttered 
area,  the  object  area,  for  purposes  of  calculation,  is  the  equivalent 
object  width  divided  by  2,  times  the  equivalent  object  length.  This 
is  true  for  both  the  periodic  and  aperiodic  image  calculation  when  the 
dual  criterion  is  used.  Similarly,  for  recognition,  the  object  area 
for  calculation  purposes,  is  the  equivalent  object  width  divided  by  S, 
times  the  equivalent  object  length. 

In  calculating  resolution,  we  match  the  image  signal-to-noise 
ratio  obtainable  from  the  sensor  to  that  required  by  the  observer. 

This  usually  involves  a  trial  and  error  or  a  graphical  soliition  to 
determine  scene  object  resolution  thresholds.  A  somewhat  simpler 
approach  might  be  to  average  the  SNR^'s  calculated  on  the  periodic/ 
aperiodic  bases  and  calculate  resolution  thresholds  on  the  average. 

This  could  be  a  good  approximation. 

The  detection  of  simple  aperiodic  objects  such  as  squares  find 
rectangles  can  be  precisely  predicted.  Similarly,  we  can  predict  the 
detectability  of  periodic  bar  or  sine  wave  patterns  with  high  accuracy. 

It  can,  however,  be  correctly  inferred  that  the  extension  of  the 
theory  of  detection  of  simple  periodic  or  aperiodic  objects  to  real 
scene  objects  is  an  unprecise  art  needing  considerable  further  work. 
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TV  Lines 
per 


*  Treated  as  an  Aperiodic  Object. 


ThreshoDjd  SNRpj  for 
Spatial  Frequency 
(Ltnes/Pict.  Ht.) 


Discrimination 

Level 

Backcround 

Minimum 

Dimension 

100 

of 

200 

iQQ 

200 

Detection 

Uniform* 

1 

2.8 

2.8 

2.8 

2.8 

Detection 

Clutter 

2 

2.9 

2.5 

2.5 

Recognition 

Uniform 

6 

2.9 

2.5 

2  5 

Recognition 

Clutter 

B 

6 .4 

3.9 

3.4 

3.4 

Identification 

Uniform 

13 

5.8 

3.6 

3.0 

3.0 

Table  3  Best  Estimate  of  Threshold  SNEj^j  for  Detection,  Recognition  and 
Identification  of  Images. 


Fortunately,  the  sensitivity  of  the  equations  to  the  various  alternative 
criteria,  when  real  scene  parameters  are  taken  into  account,  is  not 
large  so  that  reasonable  predictions  result. 

We  observed  that  to  obtain  resolution  predictions,  it  is  necessary 
to  deterniine  observer  signal-to-noise  ratio  requirements.  A  large 
number  of  psychophysical  experiments  were  performed  to  determine  these 
observer  requirements  for  various  visual  tasks  and  were  reported  in  Ref.  2. 
Further  work  in  this  area  has  been  undertaken  and  is  reported  in  this 
document.  In  Ref.  2,  the  threshold  signal-to-noise  ratios  required  by 
the  observer  for  various  levels  of  object  discrimination  were  experimentally 
determined  using  the  equivalent  bar  pattern  approach  and  are  noted  in 
Table  3.  We  note  once  again  that  the  threshold  signal-to-noise  ratio  values 
indicated  were  based  on  the  equivalent  bar  pattern  approach  and  apply  to 
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3  •  5 : 1  which  penalizes  the  detection  of  low  frequency  bai’  patterns .  We 
also  noted  in  Ref.  2  that  the  signal-to-noise  ratio  calculated  for  the 
recognition  and  identification  of  real  objects  was  performed  in  a  somewhat 
different  manner  than  for  the  equivalent  bar  pattern  with  the  probable 
result  that  the  values  of  Table  3  are  too  high.  This  inequity  will 
be  compensated  in  part  by  use  of  the  dual  periodic-aperiodic  image 
calculation  approach. 

Again,  we  note  that  the  resolution  prediction  equations  are  not  of 
great  sensitivity  to  the  signsi-to-noise  ratio  thresholds.  For  first 
cut  calculations,  we  shall  assume  that  the  observer  requires  a  signal- 
to-'noise  ratio  of  3  *0  to  defect  either  an  aperiodic  or  periodic 
object  at  the  50%  level  of  probability  and,  that  this  number  is 
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relatively  independent  of  the  equivalent  bar  pattern’s  spatial  frequency. 
For  other  values  of  probability,  the  threshold  signal-to-noise  ratio 
should  be  increased  by  the  factor  shown  in  Fig.  5. 

With  the  understandings  developed  above,  we  progress  to  examples 
of  range  prediction  starting  first  with  the  passive  scene  imaging  case 
followed  by  the  active  image  case.  Initially,  we  will  consider  the 
relative  scene  camera  motion  to  be  zero  and  then  discuss  motion  as  a 
factor. 

2.2  Passive  i'elevision  Imaging  System 

A  passive  Imaging  system  is  one  which  images  a  scene  lighted  only 
by  natural  scene  sources  such  as  the  sun,  moon,  sky  or  stars.  To 
ill.ustrate  the  analysis  of  a  passive  system,  we  will  consider  a  specific 
television  telescope  with  parameters  as  given  in  Table  k>  This  system 
is  primarily  intended  for  daylight  use  but  twilight  capability  is  desjjed. 
The  level  of  object  discrimination  required  is  the  recognition  of 
scene  objects  which  are  of  essentially  square  geometry.  We  will  first 
assume  that  the  scene  is  stationary  and  that  no  atmosphere  intervenes 
between  the  scene  and  observer.  Then  the  case  of  restricted  visibility 
will  be  considered  and  later,  in  Section  2.4,  we  will  consider  relative 
sensor-to-scene  motion. 

The  TV  systems  MTF  and  HTF  related  parameters  are  given  in  Table  4 
ard  Hg.  6.  Tlie  principal  MTFs  are  those  of  the  lens  and  the  camera 
tube  target.  Using  Eq.  (lif),  the  SNRjj  is  calculated  for  the  periodic 
eqaivaJ.ent  bar  pattern  and  plotted  in  Fig.  7.  Similarly,  the  SNRj^ 
is  calculated  using  the  aperiodic  Eq.  (U)  and  are  plotted  in  Fig.  8. 
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LENS 

Field-of-View 
Focal  Length 
T/Stop 
MTF 

Noise  Equiv.  Bandwidth  (N  ) 

6 


1.13°  X  0.85° 

660  mm 
10 

Fig.  10 

330  Lines/Pict. .  Ht. 


CAMERA  TUBE 
Type 

Photocathode 

lype 

Responsivity 
Effective  Area 
Gain-Storage  Target 
Type 

Diameter 

Gain 

Ma:x-  Average  Signal  Current 
MTF 

Noise  Equiv.  Bandwidth 


16/16  ram  EBSICON 


3.2  mA/W  (2854°  K  Source) 
1.28  X  10-4  m2 

Silicon  Diode  Matrix 
l6  mm 

2  to  2000  (Variable) 

3  X  10-7  Amperes 
Fig.  10 

170  Lines/Pict .  Ht . 


VIDEO  PROCESSOR 

Preamp  Noise  6  x  10-9  Ampei’e 

Video  Bandwidth  6  x  10°  Hz 


SCENE 

Object  Geometry  Square 

Level  of  Discrimination  Recognition 

Equivalent  Bar  Ht.  to  Width  Ratio  (e)  8 

Irradiance  Variable 

Average  Reflectivity  0.15 


Table  4  Assumed  TV  and  Scene  Parameters. 
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0  100  200  300  400  500  600  700  lXX) 

Spatial  B’requency  (Lines/Pict .  Ht .) 

_ _ _ _ — - -  -  - — -  - -  - - ‘ 

Fig.  6  MTF  .gnd  MTF  Related  Functions  foi'  the  Assumed  Sample  System. 


These  curves  represent  the  iiuage  signal-to-noise  I'atio  obtainable  from 
the  sensor.  Oa  the  same  curves,  we  shew  t.ho  observei”’ ' s  signal~to~noisfa 
ratio  thresholds.  The  observe:' 's  threshold  ShRj^,  as  wa  noted  in  the 
previous  section  is  approximately  constant  and  indeoendant  of  the  input 
image  contrast.  As  scene  object  contrast  is  reduced,  the  SNR  obtainable 
from  the  sensor  decreases.  However,  for  analytical  conveniences,  it  is 
assumed  that  the  observer's  increases  as  ths  object  contrast 

decreases,  i.e., 


SNRpij,  (for  Object  Contrast,  Cj^)  = 


SNRp.j,  (for  !::jj  =  1.0; 


(17) 


This  assumption  greatly  reduces  the  number  of  curves  to  be  drawn. 

Tlie  intersection  of  the  SNR^  and  SNRj^.p  curves  gives  the  threshold 
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Spatial  Frequency  (Linee/Pict.  Ht.) 


Fig.  7  Display  Signal-to-Noise  Ratio  vs  Spatial  Frequency  for  the  Assumed 
System  at  Various  Average  Input  Photocathode  Currents  for  Bar 
Pattern  Images. 
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Fig.  8  Display  Signal-to-Noise  Ratio  vs  Spatial  Frequency  for  the 

Assumed  System  at  Various  Average  Input  Photocathode  Currents  for 


Aperiodic  Images. 


resolution  vs  input  photocurrent  curves  shown  in  Fig.  9  and  10.  The 
very  high  resolution  numbers  associated  with  the  aperiodic  objects 
may  appear  startling  at  first,  but  as  will  be  shown  in  Section  5, 
resolutions  of  the  order  predicted  are  in  fact  realized  in  real  systems. 

It  is  seen  that  the  MTF  of  the  sensor  has  a  much  smaller  effect  on 
aperiodic  images  than  on  periodic  images. 

We  have  proposed  that  the  system  resolution  be  the  average  of  the 
resolution  calculated  on  the  basis  of  the  aperiodic  object  and  the 
periodic  object.  A  similar  concept  has  been  proposed  by  Schade  (Ref.  k) 
which  he  refers  to  as  balanced  resolution.  Schade  notes  that 
aperiodic  objects  are  more  frequently  observed  in  nature  than  periodic 
objects  but  he  weights  the  periodic  and  aperiodic  resolution  estimates 
equally  as  we  have  tentatively  suggested.  The  method  of  weighling  is  con¬ 
sidered  open  to  revisions  in  the  future  and  as  discussed  in  Section  2.5. 

Using  the  balanced  resolution  concept,  the  range  predicted  for 
sensors  will  substantially  increase  On  the  other  hand,  we  note  that 
range  estimates  made  previously  on  the  basis  of  the  equivalent  oar 
pattern  (or  periodic  model)  seemed  to  correlate  reasonably  well  with 
observed  ranges  in  many  cases.  However,  this  cannot  be  construed  as 
an  indication  of  the  superiority  of  the  periodic  resolution  model  as 
opposed  to  the  balanced  (aperiodic/periodic)  model.  The  reason  for  the 
apparent  superiority  of  the  equivalent  bar  patteiTi  (periodic)  approach  is 
that  in  previous  systems  analysis  it  has  been  usual,  more  often  than 
not,  to  ignore  a  considerable  number  of  image  degrading  effects 
including 

1)  sensor  time  constants 
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resolution  vs  input  photocurrent  curves  shown  in  Fig,  9  and  10.  The 
very  high  resolution  numbers  associated  with  the  aperiodic  objects 
may  appear  startling  at  first,  but  as  will  be  shown  in  Section  5, 
resolutions  of  the  order  predicted  are  in  fact  realized  in  real  systems. 

It  is  seen  that  the  MTF  of  the  sensor  has  a  much  smaller  effect  on 
aperiodic  images  than  on  periodic  images. 

We  have  proposed  that  the  system  resolution  be  the  average  of  the 
resolution  calculated  on  the  basis  of  the  aperiodic  object  and  the 
periodic  object.  A  similar  concept  has  been  proposed  by  Schade  (Ref.  4) 
which  he  refers  to  as  balanced  resolution.  Schade  notes  that 
aperiodic  objects  are  more  frequently  observed  in  natiore  than  periodic 
objects  but  he  weights  the  periodic  and  aperiodic  resolution  estimates 
equally  as  we  have  tentatively  suggested.  The  method  of  weighting  is  con¬ 
sidered  open  to  revisions  in  the  future  and  as  discussed  in  Section  2.5. 

Using  the  balanced  resolution  concept,  the  range  predicted  for 
sensors  will  substantially  increase  On  the  other  hand,  we  note  that 
range  estimates  made  previoiAsly  on  the  basis  of  the  equivalent  oar 
pattern,  (or  periodic  model)  seemed  to  correlate  reasonably  well  with 
observed  ranges  in  many  cases.  However,  this  cannot  be  construed  as 
an  indication  of  the  superiority  of  the  periodic  resolution  model  as 
opposed  to  the  balanced  (aperiodic/periodic)  model.  The  reason  for  the 
apparent  superiority  of  the  equivalent  bar  pattern  (periodic)  approach  is 
that  in  previous  systems  analysis  it  has  been  usual,  more  often  than 
not,  to  ignore  a  considerable  number  of  image  degrading  effects 
including 

1)  sensor  time  constants 
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int  for  the  Assumed  System  with  Input  Image 


ig.  10  Threshold  Kesolution  vs  Average  Input  Photocurrent  for  the  Assxuned  System  vri.' 
Modulation  Contrast  of  0.1. 


2)  line-of-sight  instability 

3)  MTF  in  the  vertical  direction 

4)  observer  Uaitations 

5)  display  dynamic  range  limitations 

6)  system  degradation  in  the  field 

7)  certain  MTF  losses  such  as  that  due  to  aerod^Tiamic 
boundary  layers,  atmospheric  turbulence,  windows  and 
the  like 

The  point  is  that  the  pessimistic  nature  of  the  periodic  model  xmdoubtedly 
compensates  for  the  neglect  of  many  other  system  defects.  As  we  will  see, 
including  some  of  the  effects  above  in  the  periodic  model  would  cause 
range  pi'edictioriS  to  fall  far  below  the  ranges  measured. 

In  the  above,  we  hive  used  the  input  photosurfaoe  ciurrent  as  a 
parameter.  Thir  can  be  related  to  the  input  photos'orface  irradiance 
through  the  integral  relation 

i  =  f  a(\)AE(X)d\  ,  (18) 

•'o 

where  a(\)  Is  the  spectral  responsivity  of  the  photosurface,  A  is  its 
effective  area,  and  E(\)  is  its  irradiance.  For  specific  sources,  such 
as  a  tungsten  lamp,  sunlight,  etc.,  we  can  use  the  approximation 

i  -agAEg  ,  (19) 

where  Og  is  the  specific  responsivity  to  a  specific  source  irradiance 
Eg.  We  will  use  this  approximation  recognizing  its  limitations. 


35 


is  related  to  the 


The  average  input  photosurface  irradiance  E 

average  scene  irradiance  E  through  the  fonnula 

s 


E 


pav 


p  E 
^av  s 


(20) 


for  a  diffusely  reflecting  surface  of  average  reflectivity,  p  ,  and 

SLV 

a  lens  of  T  stop  =  T  where  T  is  the  ratio 


T  "  fLAl  ^ 


(21) 


with  equal  to  the  lens  focal  length,  D  equal  to  the  lens  diameter 
and  equal  to  the  lens  transmittance. 

The  sensor  resolution  is  given  in  terms  of  "lines  per  picture 

height"  which,  being  dimensionless,  is  a  convenience  in  the  sensor 
analysis  since  image  size  can  undergo  several  changes  in  the  various 

sensor  image  and  reimaging  steps.  By  xise  of  dimensionless  units,  MTF 
scale  changes  need  not  be  made.  From  a  systems  viewpoint,  the  system's 
threshold  angular  resolution  is  of  more  interest.  Knovdng  the  threshold 
resolution,  N,  lines  per  picture  height,  the  threshold  angular 
resolution,  a9,  can  be  easily  calculated  using  the  fon.\ula 


AO  - 


N«  » 


(22) 


where  Y  is  the  effective  input  photocathode  height  and  Fj^  is  the  lens 
focal  length.  A0  is  interpreted  as  the  angular  subtense  of  a  single 
bar  of  spatial  frequency  N. 

We  averaged  the  threshold  resolutions  calculated  for  the  periodic 
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and  aperiodic  images  as  plotted  in  Fig.  9.  Then  i^^  is  converted  to 
E  ,  the  highlight  scene  irradiance  using  the  combination  of  Eqs.  (19  and 
20),  i.e.. 


E 


s 


_  ^av 
Pav 


(23) 


In  the  calculation,  the  parameters  of  Table  4  were  used.  The  scene  irradi- 

2 

ance  if  given  in  Watts/m  can  be  approximately  related  to  an  equivalent 

2 

scene  illuminance  level  given  in  ft-candles  by  multiplying  the  Watts/m 
by  2.  Finally'’,  the  averaged  threshold  resolution,  expressed  in  angular 
terms  is  plotted  vs  input  photocurrent  in  Fig.  11.  The  use  of  angular 
units  has  the  merit  of  being  independent  of  the  scene  object's  linear 
dimensions . 

Before  preceding,  we  note  that  the  gain  used  in  Eqs.  (11  and  14) 
is  a  variable.  For  vary  high  scene  irradiance  levels,  the  sensor  gain 
is  reduced  to  about  2.  As  the  scene  irradiance  is  reduced,  the 
sensor  gain  is  Increased  until  it  reaches  its  maximum  value  (2000  for  the 
sensor  assumed) . 

The  resolving  power  of  a  real  imaging  system  ^dll  be  degraded  by 
the  atmosphere  intervening  between  the  scene  and  observer.  The  amount 
of  degradation  will  be  primarily  a  function  of  the  scene-to-camera 
range,  the  meteorological  visibility,  the  sky  condition  and  the  sky- 
to-ground  brightness  ratio.  These  factors  are  discussed  in  some 
detail  in  (Ref.  2)  but  will  be  briefly  reviewed  here. 

The  meteorological  visibility  is  a  f\mction  of  the  number  and 
sizes  of  particles  in  the  air  and  its  effect  on  scene  object  detectivity 
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is,  to  a  certain  extent,  a  function  of  the  directivity  and  the  type  of 
scene  light.  Subjectively,  the  visibility  is  described  by  terms 
such  as  exceptionally  clear,  very  clear,  clear,  haze  and  fog. 
Semiquantitatively,  the  visibility  is  described  by  the  maximum  range  at 
which  a  large  black  object  \'lewod  against  the  horizon  sky  becomes 
barely  perceptible  when  its  apparent  contrast  in  the  visible  spectrum 
at  the  observer's  location  drops  to  2%. 

For  the  case  of  a  black  object  viewed  against  the  horizon  sky, 
the  ratio  of  apparent  contrast,  i.e.,  the  objects  contrast  at  range,  R, 
to  the  inherent  contrast  at  range  zero,  is 


where  a  is  the  atmospheric  extinction  coefficient.  The  primary  effect 
of  the  atmosphere  in  this  case  is  to  increase  the  object ' s  brightness 
leaving  the  backgroxuid  (sky)  brightness  unchanged.  In  the  air-to- 
gro’ond  surveillance  case,  the  atmosphere  increases  the  brightness  of 
both  the  object  and  the  background  so  that  the  equation  for  contrast 
reduction  becomes 

fs _ 1 _ 

wher-'.  S/G  is  the  ratio  of  the  brightness  of  the  horizon  sky  to  that  of 
the  grounds.  For  a  clear  sky 
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Skv  Condition 

Ground  Condition 

Clear 

Fresh  Snow 

0.2 

Clear 

Desert 

1.4 

Clear 

Forest 

5.0 

Overcast 

Fresh  Snow 

1.0 

Overcast 

Desert 

7.0 

Overcast 

Forest 

25.0 

Table  5  Typical  Values  of  the  Sky-to-Ground  Ratio. 


vjhere  p  is  the  background  reflectivity.  For  an  overcast  sky 


S  1 

•—  rs/  — 

G  P 


(27) 


Mddleton  (Ref.  5)  gives  the  typical  values  of  Table  5.  The  case  of  S/G 
=  1  for  the  do’wnlook  case  is  identical  to  the  caye  of  viewing  an  object 
against  the  horizon  sky.  When  S/G  <  1.0,  as  for  fresh  snow  under  a 
clear  sky,  contrast  degradation  is  less  than  for  viewing  against  the 
horizon  sky  and  conversely,  it  is  gr-eater  when  S/G  >1.0. 

Curves  of  Cj^/C^  are  shown  in  Vig.  12  as  a  function  of  range  for 
various  values  of  S/G.  It  is  seen  that  Cj^/C^  falls  off  very  rapidly 
for  S/G  large.  These  curves  wer-e  drawn  for  a  visibility  of  10  nmi. 
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In  Table  5,  it  was  noted  that  M±th  a  clear  sky  and  a  desert  background, 

S/G  =  1.4  while  with  the  same  background  under  an  overcast  sky, 

S/G  =7.0.  Assuming  a  20  nmi  visibility  (very  clear)  is  plotted 

for  S/G  =1.4  and  7  in  Fig.  13.  It  is  seen  that  the  image  contrast, 

Cj^,  falls  off  much  more  quickly  for  an  overcast  sky  (S/G  =  7  *0) 
than  it  does  for  a  clear  sky  (S/G  =  1.4).  In  both  cases,  the  same 
scene  is  being  viewed. 

Suppose  that  a  bar  pattern  is  used  as  a  test  object  in  the  flight 
evaluation  of  the  equipment.  Including  the  effect  of  atmospherics, 
the  SNRjj  Eq.  (14)  applies  except  that 

Cjj  =  Cj^yCl  -  S/G(l  -  e'*'  °^)]  ,  (2S) 

where  is  the  object  contrast  at  zero  range.  At  a  given  scene 
light  level,  the  signal,  being  contrast  dependent,  becomes  range  dependent 
In  turn  as  shown  in  t4g.  14*  With  no  atmosphere,  i.e.,  a  vacuum,  the 
TV  camera  resolution  would  be  independent  of  range  as  shown  by  the 
dashed  line.  With  a  real  atmosphere  of  20  nmi  visibility,  the 
sensor  resolution  drops  from  620  lines  to  about  46O  lines  at  40,000 
feet  viewing  a  desert  scene  under  clear  sky  conditions.  Under  overcast 
sky,  the  resolution  drops  from  620  to  300  lines.  The  equivalent 
curves  ejqjressed  in  terms  of  angiiLar  resolution  are  shown  in  Fig.  15. 

Also,  the  effect  of  the  atmosphere  and  the  sky-to-ground  ratio  on  other 
values  of  contrast  are  shown  in  Figs.  I6  and  17. 


Range  (Nautical  Miles) 


12  Ratio  of  Apparent  to  Inherent  Contrast  vs  Range  for  Various  Values 
of  Sky-to-Ground  Ratio  for  a  Meteorological  Visibility  of 
10  Nautical  HLles . 


; .  13  Ratio  of  Image  Contrast  at  Range  R  to  that  at  Range  Zero  vs  Range 
for  a  Meteorological  Visibility  of  20  Nautical  Miles  and  Sky-to- 
Ground  Ratios  of  1.4  and  7.0. 
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Fig. 14  Threshold  Resolution  vs  Range  for  a  Meteox’ological  Visibility  of 
20  Nautical  Miles  and  Sky-to-Ground  Ratios  of  1.4  and  7*0' 


Fig. 15  Threshold  Angular  Fiesolution  vs  Range  for  a  Meteorological 

Visibility  of  20  Nautical  Miles  and  Sky-to-Ground  Ratios  of  1.4 
and  7 .0. 


Fig.  l6  Threshold  Angular  Resolution  for  Bar  Patterns  vs  Range  for  the 
Assumed  TV  Camera  as  a  F'.unction  of  Input  Image  Contrast  for  a 
20  nmi  Visibility  and  a  Sky/Ground  Ratio  of  1.4. 


Fig.  17  Threshold  Angular  Resolution  for  Bar  Patterns  vs  Range  for  the 
Assumed  TV  Camera  as  a  Function  of  Input  Image  Contrast  for  a 
20  nmi  Visibility  and  a  Sky /Ground  Ratio  of  7.0. 
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The  atmosphere  may  also  have  a  modulation  transfer  function  due  to 
thermal  gradients,  inversion  layers,  etc.  These  are  most  serious  for 
ground  based  TV  telescopes  but  do  affect  air-to-ground  viewing  as 
well.  These  effects  are  noted  but  not  analyzed  fxurther  herein. 

2.3  Active  Television  Imaging  Systems 

An  active  imaging  system  is  one  which  Images  a  scene  lighted  by  an 
auxiliary  system  source.  In  the  case  of  interest  here,  the  auxiliary 
source  is  located  near  the  television  telescope.  A  sinqsle  search  light 
qualifies  as  an  auxiliaa?y  source  but  the  trend  in  recent  sophisticated 
systems  is  to  use  a  pulsed  laser  which  may  be  range  gated  to  eliminate 
atmospheric  backscatter.  The  analysis  of  active  television  systems  of 
the  range  gated  variety  has  been  treated  In  some  detail  in  Ref.  2  but 
will  be  reconsidered  using  the  updated  model. 

The  system  parameters  will  be  identical  to  those  considered  in  the 
previous  section  with  the  primary  change  being  the  addition  of  a  40  watt 
system  source  (sometimes  called  an  illuminator),  an  image  intensifier  and 
an  electronic  exposure  gate  for  the  TV  camera.  The  system  source  is 
of  the  GaAs  variety  which  provides  O.85  micron  radiation  in  2  txs  bursts. 
The  photoresponse  of  the  input  photocathode  is  taken  to  be  2.5  x  10 
A/^W  and  the  intensifier  gain  is  presumed  to  be  20  (ratio  of  current  in  the 
TV  camera  tube  to  that  in  the  intensifier) .  For  first  order  analysis, 

The  Eqs.  (ll  and  I4)  wiLl  be  used  as  for  the  passive  case.  The  principal 
differences  from  a  systems  viewpoint  are  that  the  inherent  scene  contrasts 
will  tend  to  be  higher,  the  atmosphere  will  have  a  much  smaller  effect 
on  the  apparent  scene  contrast  but  may  severely  decrease  scene  irradiaI^ce. 
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An  active  system,  used  only  during  the  night  hours,  vdll  usually  be 
limited  by  a  low  scene  irradiance  and  phot  oelectron  noise  rather 
than  by  preamplifier  noise  as  is  the  case  for  a  daylight  system.  Since 
light  levels  are  low,  the  designer  of  an  active  system  seeks  high 
sensitivity  and  low  sensor  lag  rather  than  a  large  signal  storage 
capability  as  the  daylight  system  designer  does. 

The  actual  scene  irradiance  is  given  by  the  relation 

E  =  P  exp(-  aR)/a)R^  ,  (29) 

where  is  the  source  power  (watts),  a  is  the  atmospheric  extinction 
coefficient,  (u  is  the  solid  angle  irradiated  (sr),  and  R  is  the  slant 
range  from  camera  to  scene.  The  average  sensor  irradiance  level  assuming 
a  diffuse  scene  is  obtained  from 


E 

pc 


PavV^^“ 

2  2 

4TV 


(30) 


where  is  the  average  scene  reflectivity  and  T  is  the  lens  T/stop 
(equal  to  the  lens  f-number  divided  by  the  square  root  of  the  lens' 
transmittance) .  Note  that  the  atmosphere  decreases  the  scene  irradiance 
on  both  its  trip  to  the  scene  and  its  return.  The  input  photosurface 
current,  i„„,  is  given  by 

3 V 


p  SAP  exp(-  2aR) 
^  av  0  ' 

- - 


(31) 


where  S  is  the  photosurface  responsivity  (A/W)  and  A  is  its  effective 
ai'ea.  The  above  photocurrent  is  plotted  in  Fig.  18  for  3  values  of 
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Average  Input  Photoc\arrent  (Amperes) 


Fig.  18  Average  Input  Photocurrent  for  the  Assumed  System  vs  Pvtuigc  for 
Average  Scene  Reflectivity  of  0.3 • 


Spatial  Frequency  (Lines/Pict.  Ht.) 

Fig.  19  MTF  and  MTF  Related  Quantities  for  the  l6/i6/l6  mm  I-EBSICON 
Camera  Used  in  the  Assumed  System. 

visibility  (sea  level,  horizontal  path  assumed).  From  these  curves,  it 

is  possible  to  make  some  resolution  vs  range  estimates  directly.  A 

typical  l6  ram  I-EBSICON  camera  tube,  operated  at  full  gain  saturates 

\'tlth  input  photocurrents  near  about  5  x  10~^  Ampere.  For  high  scene 

-13 

contrasts,  it  is  possible  to  image  with  currents  as  low  as  10  A  while, 

-12 

for  moderately  low  contrasts,  10  A  may  be  required.  For  the 
moderately  low  contrast  case,  the  range  at  which  a  reasonably  good  image 
will  be  obtained  will  vary  from  about  3*5  to  15  kilometers  depending 
upon  the  visibility. 

The  MTF  and  MTF  related  quantities  are  shown  in  Fig.  19 .  As  can 
be  seen,  the  intensifier  has  an  appreciable  effect  on  the  overall  square 
wave  flux  response.  Because  of  the  high  gain  of  the  intensifier  and  camera 
tube  (~  40,000),  the  Eqs.  (U  and  14)  reduce  to 
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(32) 


SNIL  =  [^]^*  i* - - - 

^  C®«xLT(N)r^(N)«yi,T(N)ry^(N)]^ 

for  aperiodic  objects  and  for  periodic  objects 


[e«yi,i(lI)ryj(lI)e^(N)]- 


These  SNRp  values  are  plotted  in  Pigs.  20  and  21  for  an  inherent  object 

contrast  of  0.5  and  a  meteorological  visibility  of  20  n,  miles.  The 

meteorological  visibilitj’’  determines  the  average  photocurrent  as  given 

by  Eq.  31,  The  threshold  resolution  vs  range  is  plotted  in  Fig.  22  in 

terms  of  bar  pattern  spatial  frequency  and  in  terms  of  angular  subtense 

of  a  single  bar  in  Fig.  23.  It  is  seen  that  the  aperiodic  resolution 
dominates  as  was  noted  in  the  passive  imaging  case  but  the  difference 

between  periodic  and  aperiodic  resolution  is  not  as  pronounced.  Note 

that  as  range  increases,  the  resolution  predicted  on  the  periodic  model 

basis  approaches  that  predicted  on  an  aperiodic  model. 

In  the  above,  we  neglected  the  loss  of  image  contrast  due  to  a  finite 

laser  pulse  width  and  a  finite  range  gate  interval.  These  effects  are 

discussed  in  some  detail  in  Ref.  2. 

2. 4  Effects  of  Image  Motion 

We  have  seen  that  the  resolution  of  scene  detail  can  be  limited 
by  the  ambient  light  level,  system  generated  noises  and  by  the  at¬ 
mosphere.  To  these  limitations,  we  now  add  relative  scene  motion. 

The  effects  of  image  motion  are  to  cause  the  image  to  blur  in  a  manner 
analogous  to  the  blur  caused  by  an  added  system  aperture.  Indeed, 
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Fig.  20  Display  Signal-to-Noise  Ratio  vs  Spatial  Frequency  for  the 

Assumed  Active  System  for  an  Inherent  Image  Contrast  of  0.5  and 
a  Visibility  of  20  n.  mi.  Calculations  are  based  on  the  Aperiodic 
Image  Model. 


Fig.  21  Display  Signal-to-Noise  Ratio  vs  Spatial  Frequency  for  the 
Assumed  Active  System  for  an  Inherent  Image  Contrast  of  0.5 
and  a  Visibility  of  20  n.  mi.  Calculations  Based  on  the 
Periodic  Image  Model. 
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Fig .  22  Threshold  Resolution  in  Lines/Pict .  Ht .  for  the  Assumed  Active 
System  vs  Range.  Irlierent  Image  Contrast  is  0.5. 


Fig.  23  Tlireshold  Resolution  in  Angular  Subtense  of  a  Single  Line  vs 
Range  for  the  Assumed  Active  System.  Inherent  Image  Contrast 
is  0.5. 
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motion  effects  can  often  be  described  in  terms  of  a  modulation  transfer 
function. 

One  effect  of  image  motion  is  to  Induce  image  lag  effects  due  to  the 
W  system's  read-in  and  read-out  time  constants.  These  effects  are  light 
level  dependent;  being  most  pronounced  at  the  lower  light  levels.  We 
shall  consider  these  effects  following  the  discussion  of  the  effects 
of  exposui’e  time. 

Relative  scene  motion  may  be  caused  by  machinery  within  the  TV 
camera  enclosure  (such  as  blowers  or  pumps)  by  noise  In  motion  sensors 
such  as  gyros,  by  platform  perturbations  such  as  aircraft  vibration  or 
by  the  forward  motion  of  the  platform  as  occurs  in  flight.  This  relative 

image  motion  is  a  problem  because  the  TV  camera  has  an  exposure  ti.jie . 

Typically,  the  television  camera  has  an  exposure  time  of  1/30 

second  although,  under  high  light  levels,  the  effective  exposure  time 
may  be  reduced  to  near  the  field  timf;  of  l/60  second.  This  reduction 
in  effective  exposure  time  is  due  to  the  readout  of  both  fields  by  the 
electron  beam  during  a  single  scan  of  the  charge  storage  surface.  The 
result  is  low  resolution  pictures,  presented  displaced  by  one  line  from 
one  field  to  the  next.  The  resultant  picture  resolution  is  higher  than 
that  of  either  field  alone  but  probably  not  as  high  as  it  would  be  if  the 
picture  on  each  field  were  independent  from  the  other.  These  effects 
have  been  noted  but  lack  quantitative  measure.  For  the  purposes  of  this 
discussion,  the  TV  exposure  time  will  be  assumed  to  be  1/30  second 
unless  otherwise  noted. 

Except  for  the  usual  effects  due  to  scanning,  the  exposure  or  frame 
time  of  a  television  camera  is  directly  analogous  to  the  exposure  time  of 
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a  photographic  camera.  A  photographer,  taking  even  stationary  scene 

pictures,  must  be  very  careful  to  avoid  jiggling  his  camera  when  using 

exposure  times  of  the  order  of  1/30  second.  Ordinarily,  he  will  prefer 

to  use  l/lOO  to  1/200  second  exposure  times  to  avoid  camera  motion 

problems,  hhen  photographing  action  scenes,  exposm-e  times  are  usually 

reduced  further  to  about  1/500  second  or  less.  It  is  noted  that  the 

effect  of  image  blur  due  to  relative  scene  or  camera  motion  may  be 

worse  for  a  single  photographic  expcsure  than  it  is  for  cinematography 

or  for  television  idiere  several  blurred  pictures,  slightly  displaced, 

may  combine  in  the  observer's  eye  to  form  an  overall  image  of  greater 

clarity  as  in  the  television  case  where  both  fields  are  readout  in  a 
single  field  as  discussed  above.  Again,  these  effects  have  not  been 

quantitatively  investigated  to  the  author's  knowledge. 

Given  a  stationary  camera,  the  relative  scene  motion  is  a  function 
of  the  distance  of  the  scene  from  the  camera.  It  is  clearly  more 
difficult  to  photograph  a  60  mph  car  passing  across  the  camera  viewfield 
at  a  range  of  10  feet  than  it  is  at  1000  feet,  iln  the  usual,  airborne 
reconnaissance  system,  ranges  are  very  long  —  typically,  5000  to  50,000 
feet  and  the  scene  motion  is  relatively  negligible.  However,  the 
camera's  line-of-sight  is  continually  being  pert-urbed  by  the  aircraft's 
velocity,  the  ambient  vibration  of  environment,  and  the  mechanisms 
required  to  slew,  point  and  stabilize  the  line-of-sight.  In  general, 
the  line-of-sight  will  be  in  continuous  motion  of  some  kind.  Even  when 
a  ground  point  is  being  perfectly  tracked,  onlir  one  point  in  the  image 
will  be  stationary  —  all  other  points  in  the  viewfield  will  be  in  rela¬ 
tive  angular  motion.  Many  of  these  effects  have  been  discussed  in 
considerable  detail  in  Ref,  2. 
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Consider  an  aircraft  in  straight  and  level  flight.  Let  a  TV  camera 

view  the  ground  with  a  fixed  depression  angle.  Then  the  line-of -sight 

to  the  fixed  ground  point  will  rotate  as  the  aircraft  flies  toward  it. 

The  imag  >,  of  the  point  will  travel  from  ohe  bottom  of  the  picture  to  the 

top.  For  changes  in  the  sightline  which  are  not  too  large,  the  rate  of 

image  motion  is  approximately  linear.  Alternatively,  the  line-of -sight 

may  oscillate  about  the  ground  point  with  reasonably  constant  anqplitude 

and  frequency  due  to  mechanical  resonances,  or  oscillate  with  randan 

amplitudes  and  frequencies  due  to  noises  generated  by  the  inertial 
sensors  or  due  to  other  noises  transmitted  by  the  mechanical  structure. 

The  eye  can  track  scene  objects  which  are  moving  at  very  high 
angular  rates  compared  to  the  angular  rates  which  the  television  camera 
will  tolerate  without  losing  significant  scene  resolution.  Thus,  for 
oui'  purposes,  we  can  concentrate  on  the  motion-induced  sensor  effects. 

It  is  also  clear  that  to  blur  an  image,  the  image's  motion  must  be  com¬ 
paratively  large  during  an  exposure  time.  However,  the  term  large  is 
relative  to  the  size  of  the  image  detail  to  be  resolved.  The  amount  a 
small  object  can  move  without  being  blurred  beyond  recognition  is  also 
small. 

Tlie  effects  of  image  motion  on  scene  resolution  has  been  analytically 
treated  for  a  number  of  simple  but  quite  comaon  cases  (Ref.  6).  These 
are  linear  motion,  sinusoidal  vibration  of  constant  amplitude,  and  sinu¬ 
soidal  vibration  of  random  amplitude.  These  will  be  discussed  below.  As 
one  would  intuitively  expect,  linear  motion  is  the  least  degrading  and 
random  motion  is  the  most . 

In  photographing  or  televising  an  object  passing  across  a  field 
of  view,  a  sharp  pxct\u:e  will  be  obtained  only  if  the  angular  rate  of 
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Fig.  24  Effect  of  Image  Motion  on  Bar  Patterns  of  Various  Spatial 
Frequencies . 

the  objeci;  is  small  relative  to  the  object's  angular  detail  during  the 

exposuiv.:  -ime.  As  the  object's  angular  rate  increases,  the  object's 

image  begins  to  blur  vdth  fine  details  being  the  first  to  disappear. 

Suppose  that  the  object  is  a  bar  pattern  as  shown  in  Fig.  24.  If  the 

coarse  pattern  of  period  6ax  moves  a  distance  24x  during  an  exposure  time, 

the  intensity  waveform  in  the  exposed  image,  though  of  the  same  amplitude, 

becomes  trapezoidal.  If  the  bar  pattern  spacing  becomes  smaller,  so 
that  the  period  is  4Ax,  the  exposed  image's  amplitude  vdthin  the  bar 

pattern  is  reduced  and  the  waveshape  tends  toward  sinusoidal.  With  a 

bar  pattern  of  period  equal  to  the  distance  moved  furing  the  exposure 

tjme,  i.e.,  2ax,  the  exposed  image  becomes  a  uniform  grey,  i.e.,  there  is 

no  modulation  in  the  exposed  image  and  the  bar  pattern  structure 

disappears . 

It  is  customaiy  in  TV  engineering  to  express  the  image  resolution 
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at  the  input  photocathode  in  terms  of  a  spatial  frequency  vdth  ’vjnits  of 
lines  per  picture  height.  That  is,  if  the  bar  (or  sine  wave)  spacing  is 


Ax  (period  of  2Ax)  and  if  the  picture  height  is  Y,  then  the  spatial 
frequency,  N,  is  equal  to 


N  = 


lines 


Ax  picture  height 


(34) 


By  analogy  with  the  above  discussion,  it  is  seen  that  if  the  image 
motion  is  2  lines  in  an  exposure  time,  then  the  output  image  modulation 
becomes  zero. 

As  shown  in  Ref.  2,  the  effect  of  linear  iriage  motion  can  be 
described  in  terms  of  a  modulation  trarisfer  function  given  by 


Ro(N)  = 


sln(nNv^ty2Y) 

TrNv^t^/2Y 


(35) 


for  v^  equal  to  the  pattern  speed  in  nm/sec,  Y  equal  to  the  picture 

height  and  t^  equal  to  the  frame  or  exposure  time.  In  laboratory 

measurements,  it  is  common  to  specify  the  bar  pattern  velocity  in  terms 

of  the  number  of  seconds,  t^,  required  for  one  bar  in  the  test  pattern 
to  traverse  the  field  of  view.  Using  this  specification,  the  pattern 

velocity  becomes 


V 

^  3t^ 


(for  a  picture  aspect  ratio  of  4/3).  Now, 


(36) 


R  (N) 
o'  ' 


sin(2nNty3t  ) 

X  s 

2nNt„/3t 
X  s 


(37) 


This  MTF  is  plotted  in  Fig.  25  for  various  pattern  velocities.  The 
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Fig.  25  Modulation  Transfer  Function  Due  to  Linear  Image  Motion  Plotted 
to  Second  Zero  for  Various  Bar  Pattern  Velocities  Expressed  in 
Terms  of  Time  for  Pattern  to  Traverse  Pictvire  Width. 

response  is  seen  to  go  to  zero  and  then  increase  again  as  shovm  by  the 

dashed  lines.  The  increase  in  response  after  the  first  zero  results  when 

the  bar  pattern  motion  exceeds  2  lines/exposure  time.  The  response  is 

negative  indicating  a  phase  reversal,  i.e.,  the  black  lines  appear  as 

white  on.  the  display  and  conversely.  While  a  signal  modulation 

results,  it  is  not  generally  useful  and  is  called  false  resolution.  The 

spatial  frequency  at  which  the  response  first  goes  to  zero  is  given  by 


(38) 


and  is  plotted  in  Fig.  26.  The  angular  motion  per  frame  time  corresponding 
to  is  also  plotted  in  the  same  figure  for  the  assumed  daylight  system 
of  Section  2.2. 

If  it  is  desired  to  resolve  a  certain  spatial  frequency,  say  225 


58 


Time  for  Pattern  to  Traverse 
Pictvire  Width  (seconds) 


Pig. 


26  Spatial  Frequency  and  the  Corresponding  Angular  Motion  for  the 
Assumed  System  for  vdiich  the  Simal  Modulation  is  Zero  as  a 
Function  of  Bar  Pattern  Motion  (Linear) . 


,  Ines,  the  pattern  velocity  must  be  less  than  5  seconds  per  picture 


width,  for  at  that  velocity,  the  signal  modulation  decreases  to  zero. 

How  much  less,  depends  upon  the  loss  in  signal  modulation  that  can  be 
tolerated.  For  example,  if  the  MTF  must  be  0.5  or  better  at  225  lines. 


the  cut-off  frequency  N  must  be  increased .  In  Fig .  27,  we  plot  MTF 

c 

vs  N/N  .  For  0.5  response,  N/N  is  about  0.6  and  thus  to  obtain  0.5 
c  c 

response  at  N  =  225  lines,  must  be  increased  to  225/0.6  or  375  lines 

and  the  motion  from  Fig.  26  must  be  less  than  about  8.5  sec/picture  width.. 
In  yet  another  description,  we  let  I’h®  distance 

moved  per  exposure  time  and  since  Ax  =  Y/N,  then 


sin(TTAx.y2Ax) 

^0^^^  ^  nAxy2Ax 

^  (39) 

"^v/2 
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where  is  the  number  of  lines  the  pattern  moves  in  an  exposxire  time. 
This  MTF  is  plotted  in  Fig.  28.  It  is  seen  that  if  the  bar  pattern 
moves  one  line  per  integration  time,  the  MTF  drops  to  63^  while  for  ij 
linOvS,  the  MTF  is  29^. 

In  most  air-to-ground  surveillance  tasks,  a  ground  point  must  be 
quite  preciselj’-  tracked.  The  linear  motion  MTF  argument  can  be  used  to 
conclusively  show  this  need.  Assuming  a  ground  point  is  tracked,  linear 
motion  should  not  be  much  of  a  factor  but  its  discussion  is  still  worth¬ 
while  because  it  is  the  easiest  to  understand. 

Sinusoidal  image  motion  of  constant  amplitude  can  result  from 
resonances  in  the  mechanical  structure.  The  form  of  the  motion  is 
shown  in  Fig,  29.  The  MTF  for  sinusoidal  motion  has  been  derived 
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for  the  special  case  where  the  beginning  of  a  cycle  coincides  with 
the  beginning  of  the  exposure  time  and  ends  at  the  end  of  the  exposure 
time.  Tiie  effect  will  be  the  same  whether  one  cycle  or  an  integral  number 
of  cycles  occur  within  the  exposure  time  —  the  MTF  is  a  function  only 
of  the  spatial  frequency  of  the  sinusoid  and  ■*ts  amplitude.  The  IflF  is 


(40) 


where  is  a  Bessel  function  of  zero  order,  A  is  the  peak-to~peak 
amplitude  of  the  motion  in  mm  and  Y  is  the  picture  height  also  given  in 
mm.  For  the  assumed  system,  the  amplitude.  A,  may  be  written  as  F^^  • 
where  Fj  is  the  lens  focal  length  and  a6„  is  the  peak-to-peak  angular 

L*  V 

motion .  Then, 


trF.A9„,N 


(41) 


This  function  is  plotted  in  Fig.  30  for  AS^  =  25,  50  and  100  microradians. 
Again,  a  negative  (false  resolution)  response  can  be  discerned. 

Ne;.t,  we  note  that  the  cutoff  spatial  frequency,  i.e.,  the  spatial 
frequency  at  which  the  response  goes  to  zero  in  Fig.  30  is  given  by 

=  1.53  \  ,  (42) 

vdiere  is  the  amplitude  of  the  motion  measured  in  lines  per  picture 
height.  Alternatively,  in  angular  terms 
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Bar  Pattern  Spatial  Frequency 
_ _ (Lines/Pict.  Ht.) _ 

Fig.  30  Modulation  Transfer  Function  vs  Bar  Pattern  Spatial  Frequency  for 
Sinusoidal  Motion  of  Peak  Amplitude  of  100,  50  and  25  raicroradians 
per  Exposure  Time  for  the  Assumed  System. 


A9 


1.53 


(43) 


and 


J _ 

•  ASc 


Fr  •  A9 
L  V 


(44) 


These  last  two  functions  are  plotted  in  Fig.  31.  To  illustrate,  suppose 
the  peak-to-peak  sinxisoidal  motion  is  100  microradians  per  exposure 
time.  Then  A0^,  the  angular  subtense  of  a  bar  in  the  bar  pattern  for 
which  the  signal  modulation  is  zero  is  62.8  microradians.  For  our 

assumed  system,  62.8  microradians  translates  to  a  TV  camera  resolution 
of  222  lines  per  picture  height. 

In  normalized  form,  the  modxilation  transfer  function  becomes 
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Peak-to-Peak  Angular  Amplitude 
_ (microradians) _ 

Fig.  31  Cut-off  Frequency  and  the  Angular  Subtense  of  Gut-off  Frequency 
Line  VJidth  vs  the  Peak-to-Peak  Angular  Amplitude  of  Sinusoidal 
Motion. 


,  (45) 

c 

which  is  plotted  in  Fig.  32.  This  curve  can  be  used  in  a  manner  analogous 
to  Fig.  2?  to  determine  the  value  of  the  modulation  transfer  factor 
at  a  spatial  frequency  below  the  cutoff  value. 

Finally,  the  modulation  transfer  function  is  shown  in  Fig.  33  as 
a  function  of  the  peak-to-peak  motion  given  in  terms  of  the  number  of 
lines  the  motion  subtends  at  the  spatial  frequency  in  question.  It  is 
seen  that  if  the  bar  pattern  motion  is  1  line  per  exposure  time,  the 
MTF  drops  to  U7%  and  drops  to  zero  for  motion  of  the  order  of  1.5  lines 
per  exposure  time. 


6ti 


Siabtense  of  Cut-off  Frequency 
Line  V/idth  (microradians) 


Fig.  32  Modulation  Transfer  Function  for  Sinusoidal  Motion  vs  Spatial 
Frequency  Normalized  to  the  Cut-off  Frequency. 


Peak-to-Peak  Image  Amplitude  Per 
Exposure  Time  (Lines) 


Fig.  33  Modulation  Transfer  Function  for  Sinusoidal  Image  Motion. 


It  is  seen  in  Fig.  30  that  image  motion  of  any  particular  spatial 
frequency  has  an  effect  at  all  other  spatial  frequencies.  It  may  happen 
that  the  line-of -sight  ’.-dll  vibrate  at  2  or  more  frequencies  (or  be  such 
that  it  can  be  deconposed  into  a  small  number  of  discrete  frequencies) . 

In  this  case,  the  overall  MTF  effect  can  probably  be  estimated  by  taking 
the  product  of  the  MTF's  associated  vdth  the  various  frequencies. 

Random  motion  is  perhaps  the  most  commonly  encountered  In  practice. 

For  this  case,  the  MTF  is  given  by 

MTF  =  esq^r-  |(^)^]  (46) 

with  the  terms  being  as  before  except  that  the  amplitude.  A,  is  measured 
in  terms  of  its  rms  value.  As  in  the  sinusoidal  motion  case,  we  can 
write  the  amplitude  A  as  F-AS,,  so  that 

Jj  V 

n  ttF-AQ  N  „ 

MTF  =  exp[-  .  (47) 


This  equation  is  plotted  in  Fig.  34  for  various  values  of  the  angular 
motion  amplitude  a9^. 

Since  the  exponential  term  does  not  pass  through  zero,  we 
arbitrarily  define  the  cut-off  spatial  frequency  as  that  frequency 
for  which  the  MTi'  33  0.02,  then 

=  0.89N^  ,  (48) 

where  is  the  rms  amplitude  of  the  motion  per  frame  time  measured  in 
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r'ig.  34  Modulation  Transfer  Function  for  the  Assumed  System  with  Random 
Image  Motion  of  RMS  Amplitude  25,  50  and  100  microradians  per 
Exposure  Time. 


lines  per  picture  height. 

By  analogy  to  the  sinusoida.1  motion  case,  we  can  write 


A0 


46 

_  V 

c  “  0.89  ’ 


(49) 


and 


c  Ft  » 46  * 

L  V 


(50) 


which  are  plotted  in  Fig.  35*  The  MTF  normalised  to  the  cut-off  frequency 
is  given  by 


R^(N)  =  e 


-  3.92(|-)^ 
c 


(51) 
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and  is  plotted  in  Fig.  36.  Also,  the  MTF  is  plottsd  as  a  fvinction  of  the 
rms  image  motion  amplitude  expressed  in  lines  in  Fig.  37*  Finally,  the 
MTF  is  shown  for  the  ass’amed  system  of  Section  2.2  in  Fig.  38  together 
with  tho  effect  of  a  50  microradian  rms  motion  .  As  can  be  seen, 
the  motion  MTF  completely  dominates. 

The  effect  of  random  motion  on  system  resolution  is  shown  in  Fig.  39 
in  units  of  lines  per  picture  height  and  in  Fig.  4c  in  terms  of  threshold 
angle.  These  curves  were  drawn  for  an  input  image  modulation  of  C.3  and 
three  values  of  motion  (static  and  25  and  50  microradians  rms).  The 
curves  of  threshold  angle  relate  most  directly  to  range  since  range  is 
directly  proportional  to  A6 .  With  good  visibility,  reducing  the  rms 
motion  amplitude  by  a  factor  of  2  results  in  a  50  -  60%  range  increase. 
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Fig.  37  Modulation  Transfer  Function  for  Random  Image  Motion. 
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System  Plus  Motion 


System  with  Scene  in  Random  Motion  of  RMS  Amplitude  50  microradians 
with  660  mm  Focal  Length  Lens. 


Input  Photocurrent  (Ampere) 


Fig.  39  Threshold  Resolution  vs  Input  Photocurrent  for  the  Assumed  Sensor 
with  a  Static  Scene  and  with  Random  Motion  of  the  Sightline 
of  Magnitude  25  and  50  urad .  =  0 .3 . 


Fig.  40  Threshold  Angular  Resolution  vs  Input  Photoeurrent  for  the 

the  Assumed  Sensor  vd.th  a  Static  Scene  and  vdth  Random  Motion 
of  the  Sightline  of  Magnitude  25  arid  50  urad.  =  0.3. 


The  angular  resolution  for  the  aperiodic  and  periodic  case  is  shown 
in  Fig.  41,  Also  shown  is  the  balanced  resolution  calculated  on  the 
basis  of  the  average  threshold  resolution  in  lines/pict.  ht.  These  curves 
were  drawn  for  a  random  moti.on  of  50  microradian  rtns  amplitude  and  an 
input  image  contrast  of  0.1. 

In  many  systems,  it  is  customary  to  optically  zoom  the  field  of  view 
in  order  to  have  a  wide  angle  view  (WAV)  for  general  navigation  and  a 
narrow  field  of  view  (NAV)  for  object  recognition.  In  changing  the 
field  of  view  by  say  a  factor  of  k,  it  is  hoped  to  increase  the  resolution 
of  scene  detail  by  the  same  factor.  However,  in  the  NAV,  the  hoped 
for  increase  in  resolution  will  not  usually  be  realized  because  of  the 
more  serious  effect  (f  motion  on  the  NAV.  To  show  this  effect  we  cal¬ 
culated  the  limiting  resolution  for  a  field  of  view  4  times  larger  than 
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10  —  10' 
Input  Photocathode  Current  (Ampere) 


Fig.  41  TTireshold  Angular  Resolution  vs  Input  Photocathode  Current  Based 
on  the  Periodic,  Aperiodic  and  the  Average  Calculated  for  the 
Threshold  Resolution  in  Lines/Pict.  Ht.  C,,  =*  0.1. 

M. 


that  used  in  the  discussion  heretofore  vdth  the  results  shown  in  Fig.  42. 
The  dashed  line,  shows  the  angular  resolution  in  the  WAV  (about  a  4*^ 
field  of  view)  and  the  solid  line  shows  the  angular  resolution  in  the 
NAV  (about  a  1°  field  of  view).  In  both  cases,  the  modulation  contrast 
is  assumed  to  be  0.3,  the  image  motion  is  random  of  rms  amplitude  50  micro¬ 
radians,  and  the  periodic  image  model  was  used. 

The  image  appearing  on  t/e  display  is  aci  ually  4  times  larger  in 
the  NAV  than  in  the  WAV  but  the  useful  magnification,  based  on  threshold 
angular  resolution  is  much  less  as  can  be  seen  in  Fig.  43  where  we  plot 
the  ratio  of  angular  resolution  in  the  NAV  to  that  in  the  WAV.  At  high 
light  levels,  the  actual  effective  magnification,  when  sightline 
motion  is  a  factor,  is  only  about  2  rather  than  4  as  ideally  expected. 
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Threshold  Angtilar  Resolution 


Fig.  43  Ratio  of  Threshold  Angul.u*  Rssolution  in  NAV  to  that  in  WAV  with 
Random  Sightline  Motion  of  Amplitude  50  microrad  RMS.  =  0.1. 
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The  subject  of  camera  time  constants  will  be  treated  in  detail  in 
Section  4  but  the  resxilts  wiP..  be  briefly  reviewed  here .  The  time 
constants  of  a  camera  can  be  quantitatively  thought  of  as  being 
due  to  the  capacity  and  resistance  of  the  charge  storage  surface  and  the 
resistance  of  the  reading  beam.  As  an  example,  consider  the  EBSICON 
camera  tube  which  has  a  photoemissive  photocathode  and  a  silicon  diode 
mosaic  storage  surface.  The  mosaic  is  charged  by  photoelectrons  which 
were  accelerated  through  a  large  voltage.  In  the  target,  the  energy  of 
the  photoelectrf"-  is  converted  to  hole-electron  pairs  and  the 
electrons  are  stored  in  the  capacity  of  the  back  biased  diodes.  With 
proper  desi^,  the  RC  time  constant  of  tne  diodes  is  large  enough 
so  that  the  charge  will  be  retained  for  a  nuidjer  of  frame  times  which 
implies  that  the  capacitance  of  the  targets  is  relatively  high  (for  a 
given  R).  For  readout,  the  capacitors  are  discharged  through  the  resis¬ 
tance  of  the  electron  beam  and  for  fastest  operation,  the  capacitance 
of  the  target  should  be  small.  Clearly  a  tradeoff  is  dictated  between 
target  storage  time  and  readout  time  constants.  At  low  signal  current 
operation,  the  resistance  of  the  electron  scanning  beam  is  high  and  the 
RC  time  constant  of  the  readout  process  is  higher  than  that  at  high 
signal  currents  where  the  beam  resistance  is  low  so  a  number  of  frames 
are  required  to  completely  read  out  the  charge.  This  will  have  the 
effect  of  contrast  reduction  for  dynamic  imaging. 

Target  voltage  can  also  markedly  influence  the  process.  A  large 
target  voltage,  vdiich  causes  the  target  capacity  to  decrease,  will 
decrease  the  RC  time  constant,  \diereas  with  a  low  target  voltage,  the 
target  capacity  increases  and  the  RC  time  constant  is  larger. 
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4s  shown  in  Section  k,  the  lag  introduced  by  the  RC  time  constant 
can  be  appreciable  wiuh  low  target  voltages  even  though  the  signal 
levels  are  high.  Other  tubes,  id.th  lower  prestorage  gain  such  as  the 
I-SEC  and  I-I-Isocon  have  even  greater  lag  problems.  Dynamic  MTF 
measurements  have  been  made  but  the  results  do  not  appear  to  fully 
account  for  the  considerable  loss  in  sensitivity  at  low  spatial 
frequencies.  However,  this  must  be  interpreted  as  an  inadequate  meas\ire- 
ment  procedure.  Image  lag  effects  will  be  a  major  concern  in  the  follow-on 
program.  Because  of  the  preliminary  nature  of  the  results  obtained  so 
far,  we  do  not  propose  a  method  of  including  lag  effects  into  the  analysis 
at  this  time.  The  designer  is  cautioned,  however,  that  the  loss  in  sen¬ 
sitivity  due  to  lag  may  be  as  much  as  a  factor  of  4  to  100  at  low  light 
levels  and  due  account  of  lag  effects  should  be  made  in  selecting  a 
sensor  for  a  given  application. 

2.5  The  Balanced  Resolution  Concept 

The  effort  in  sensory  system  modeling  for  the  purpose  of  pre¬ 
dicting  the  range  at  which  a  real  scene  object  can  be  discerned  is  to 
find  a  simpler  equivalent  teat  object  that  can  be  used  to  replace  the 
reaiL  scene  object.  Presumably,  a  correspondence  can  be  found  between 
the  range  at  which  the  real  scene  object  can  be  discenied  with  the 
needed  clarity  and  the  range  at  which  the  equivalent  test  object  can 
be  detected  (or  resolved).  The  simpler  equivalent  test  object  should 
be  easy  to  make  and  fully  amenable  to  analysis.  It  is,  however, 
clear  that  no  single  test  object  can  be  found  that  will  be  fullir 
equivalent  to  all  real  scene  objects  which  are  of  infinite  variety 
and  complexity.  On-the-other-hand,  if  systems  design  is  to  be 
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anything  but  a  trial  and  error  process,  equivalent  test  objects  must 
be  found. 

The  equivalent  bar  pattern  as  suggested  by  Johnson  represents  one 
of  the  first  attempts  to  find  a  test  pattern  wJiich  can  be  used  in 
laboratory  evaluation  and  analysis.  This  approach  makes  good  sense 
because  it  Imposes  a  system  resolution  requirement.  This  model 
was  further  refined  and  experimentally  tested  with  the  results  discussed 
previously  in  Ref.  2.  The  principal  deficiency  in  the  concept  was 
in  defining  the  method  of  measuring  the  image  signals  in  the  real  object. 
It  was  first  thought  that  the  average  modulation  within  the  real 
object  could  be  used  but  this  would  require  some  sort  of  area  weighting. 
In  the  end,  the  maudmum  signal  swing  was  used  which  is  different 
than  the  method  of  measuring  signal  swing  in  the  bar  pattern  which  is 
the  mean  signal. 

A  bar  pattern,  being  repetitive,  is  one  of  the  most  difficult  of  tne 
one-dimensional  images  to  detect  and  hence  it  is  felt  that  its  use 
will  result  in  pessimistic  predictions.  However,  in  the  past,  range 
predicted  using  the  equivalent  bar  pattern  has  shown  reasonable  correla¬ 
tion  with  range  measured  for  real  objects  imaged  against  a  terrain 
backgi'ound .  This  is  in  large  part  due  to  the  neglect  of  many 
important  system  parameters  such  as  sky-to-ground  brightness 
ratio,  sensor  time  constants,  iifiage  motion  and  display-obse^nrer 
interactions.  That  is,  the  pessimistic  nature  of  the  equivalent  bar 
pattern  prediction  obscures  other  system  defects  which  are,  more 
often  than  not,  neglected.  As  our  knowledge  of  these  system  defects 
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increases,  it  becomes  necessary  to  take  these  other  factors  into 
account.  In  particular,  when  an  effect  is  isolated,  such  as  sightline 
vibration,  it  is  important  that  the  impact  of  the  effect  on 
range  be  known.  Increases  in  stability,  for  example,  can  be  quite 
costly  and  the  desire  will  be  to  evaluate  the  cost  of  greater  sightline 
stability  vs  the  Improvement  in  range  to  be  expected. 

In  an  attempt  to  find  a  better  model,  the  balanced  resolution  con¬ 
cept  was  proposed.  The  first  procedvire  adopted  and  rather  extensively 
used  in  the  above  is  to  calculate  the  resolution  based  on  the 
equivalent  bar  pattern  and  then  on  a  single  bar  of  the  bar  pattern. 

For  a  given  set  of  operating  conditions,  the  calculation  results  in  two 
values  of  limiting  resolution  and  in  lines  per  picture  height. 

The  "balanced"  resolution  was  then  taken  to  be 


=  (Nj_  + 


(52) 


The  result  of  this  procedure  is  shown  in  ar.gular  resolution  form  in 
Fig.  41.  It  is  seen  that  the  results  are  dominated  by  the  aperiodic 
model  and  will  undoubtedly  give  far  too  optimistic  results.  A 
oossibility  is  to  calculate  the  aperiodic  resolution  on  the  basis  of 
an  element  of  size  equal  in  height  and  width  to  the  bar  width  in  the 
equivalent  bar  pattern. 

An  alternate  approach  is  to  calculate  the  balanced  resolution  on  the 
basis  of  the  iverags  angular  resolution.  This  is  equivalent  to 
averaging 


Input  Photocurrent  (Ampere) 


Fig.  44  Threshold  Angular  Resolution  vs  Input  Photocurrent  Based  on  the 
Periodic,  Aperiodic  and  the  Average  Calculated  for  Threshold 
Angular  Resolution  in  microradians .  =  0.1. 

A9^  =  (AS^  +  biQ^/2 


2 


(53) 


This  is  also  equivalent  to  averaging  the  ranges  calcvdated  using  tie 
aperiodic  and  periodic  model.  The  result  of  averaging  or.  an  anguTar 
basis  is  shown  in  F.vg.  44.  As  can  be  seen,  averaging  on  the  angle  basis 
biases  the  result  toward  the  periodic  model. 

If  a  choice  were  to  be  made  at  this  point  in  time,  we  would  tend  to 
favor  averaging  the  results  on  the  angle  basis  because  it  gives  results 
better  than  the  pessimistic  periodic  model  but  not  as  optimistic  as  the 
aperiodic  model  whicl;  is  considered  to  be  excessively  optimistic 
for  use  in  recognition  or  identification  models.  The  search  is,  of 
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course,  for  a  weighting  function  and,  in  particular,  for  one  which 
makes  use  of  the  currently  well  known  models  that  we  currently  have. 
However,  further  efforts  are  needed  to  justify  the  weighting  function, 
whatever  it  may  be,  on  a  rational  basis.  These  first  preliminary 
efforts  are  for  the  pvirpose  of  examining  the  Impact  of  certain 
assumptions . 
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3 .0  Display  Signal-to-Noise  Ratio  Fundamentals 

In  this  section,  vre  will  discuss  the  fundamentals  of  the  display 
signal-to-noise  ratio  concept  starting  with  the  elementary  or  ideal 
model  and  then  adding  to  the  model  to  bring  it  into  closer  correspondence 
with  reality.  The  elementary  model  takes  into  account  the  image's 
diiiensions,  signal  levels,  and  noise  levels  but  otherwise  assumes  that 
the  image  is  transmitted  through  the  sensory  system  with  perfect  spatial 
fidelity.  The  elementaiy  model  is  then  refined  by  Including  the  effects 
of  finite  imaging  apertures  such  as  the  objective  lens,  reimaging  sensors 
such  as  an  image  intensifier,  the  TV  camera  tube  and  etc.  The  images 
and  the  apertures  which  alter  the  image's  amplitude,  shape  and  position 
are  analyzed  by  Fourier  methods  using  the  methods  of  comnunications 
theory.  An  attempt  has  been  made  to  be  general  and  fairly  rigorous 
in  these  derivations.  We  are  indebted  to  Robert  L.  Sendall  of 
Electro-Optical  systems  for  many  of  the  concepts  presented  particularly 
in  the  area  of  the  aperiodi.c  image  treatment. 

In  Sections  4  and  5>  we  will  discuss  some  preliminary  efforts  made 
to  verify  the  theory.  As  will  be  seen,  the  theory  adequately  predicts 
first  order  effects  and  many  second  order  effects  as  well.  However, 
second  order  effects  are  quite  difficult  to  measure  through  psychophysical 
experimentation  partly  because  of  the  weak  functional  dependence  of  the 
effects  and  partly  because  of  the  statistical  nature  of  the  experimentation. 
3.1  The  Elementary  Model 

The  historical  development  of  the  elementary  model  was  noted  and 
the  model  was  derived  in  Ref.  2.  The  purpose  of  this  discussion  is  to 
review  the  elementary  model  and  to  give  further  insight  with  regard 
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to  its  meaning  and  use.  Tne  basic  i’onnulation  assumes  a  small  rectangular 
image  of  area,  a,  amid  a  much  larger  background.  Suppose  the  average 
number  of  photoelectror.3  generated  by  the  sensor's  photosurface  in 
time,  t,  due  to  the  image  area,  a,  is  n2  and  the  number  generated  by 
an  equally  sized  comparison  area  in  the  background  is  n^^.  Then  the 
elementary  model  as  derived  in  Ref.  2  gives  the  mean  signal-to-rms-noise 
ratio  of  the  image  as 


SNRp^  =  (ng  -  n^)/[(n3_  + 


=  (1^2  "  +  A2)at/2]^  , 


(54) 


where  and  A2  are  the  photoelectron  generation  rates  in  units  of 
electrons  per  unit  area  and  time.  The  subscript  pc  is  added  to  SNR  to 
indicate  that  this  is  the  SNR  at  the  output  of  the  input  photosurface. 
We  define  the  image  modulation  contrast  as 


P  ^2  "  *^1 


■'M 


+  n.. 


^2  ~  \ 
2n. 


av 


(55) 


so  that 


SNR  = 
pc 


(56) 


In  the  above  derivation,  it  is  assumed  that  the  noise  is  due  to  the 
image  photon-to-electron  conversion  process.  When  this  is  the  case,  the 


82 


sensor  is  said  to  be  photoelectron-noise-lindted.  For  later  convenience, 
the  photoelectron  rates,  n,  are  written  in  terms  of  the  photocurrants,  i, 
as  follows 


i  =  AeA 


(57) 


where  e  is  the  charge  of  an  electron  and  A  is  the  total  effective 
photosurface  area.  Now,  Eq.  (56)  becomes 


i 


(58) 


In  a  typical  taigh  performance  TV  camera  tube,  the  image  is  next  trans¬ 
ferred  to  a  gain  storage  target  of  gain,  Gip,  and  storage  time,  t^,  so 
that 


SNR.J. 


at 


av 


i 


(59) 


p  A 

Note  that  the  signal,  and  the  photoelectron  noise, 

are  equally  amplified  with  no  net  result  at  this  point.  In  TV,  the 
gain  storage  target  is  sequentially  scanned  line-by-line  by  an 
electron  beam.  It  is  possible  to  measure  a  signal-to-noise  ratio  in 
the  video  channel  which  is  given  by 


SNR^O  - 


^^T^vVav 

^2(G,pG^) 


(60) 
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where  the  subscript  0  in  SNR^q  refers  to  the  notion  that  the  signal 
amplitude  is  not  limited  by  the  sensor  apertures,  Gy  is  the  video  ampli¬ 
fier  gain,  and  is  the  video  bandvddth.  Combining  Eqs.  (59)  and  (6o), 
we  observe  that 

SNRp  =  [2t^fy(|)]^  SNRyQ  .  (61) 

The  subscript,  D,  is  added  to  note  that  the  image  signal-to-noise  ratio 
is  now  referred  to  the  Image  appearing  on  a  hypothetically  perfect  dis¬ 
play.  In  the  video,  the  image  is  frequency  upconverted  by  the 
electron  beam  scanning  process.  In  the  display,  the  image  frequencies 
are  downconverted  by  the  reverse  process,  i.e.,  the  electron  beam  of 
the  cathode  ray  tube  display  recreates  the  original  image  on  the 
display. 

The  image  area  ratio  (j)  is  dimensionless.  This  is  a  convenience  in 
later  analysis  because  the  real  image  area  can  become  larger  or  smaller 
as  it  traverses  the  system.  The  use  of  dimensioned  units  requires 
that  scale  changes  be  made  at  each  point  where  the  image  changes  size. 

But  even  further,  we  note  that  the  displayed  image  can  be  much  larger 
than  the  image  on  the  input  photosurface.  We  also  note  the  video 
gain,  appearing  in  Eq.  (60).  By  suitably  adjusting  the  d-c  level 
of  the  display  brightness  and  the  video  gain,  the  displayed  image  can  be 
much  brighter  and  of  greater  contrast  than  the  image  incident  on  the 
input  photosurface.  Thus,  in  theory,  the  displayed  image  can  be 
sufficiently  large,  sufficiently  bright  and  of  high  enough  contrast 


so  that  the  observer's  eye.,  vievdng  the  displsQred  imagery  vdll  be  neither 

acuity,  nor  contrast,  nor  displayed-image-brightness  limited.  If  these 
conditions  are  met,  the  SNR^  becomes  the  SNE^j,  the  image  signal-to- 
noise  ratio  generated  in  the  observer's  retina  provided*  that  the  time,  t^, 
is  changed  to  the  time,  t^,  the  Integration  time  of  the  eye. 

The  above  equations  represent  the  image  signal-to-noise  ratio 
obtainable  from  the  sensor.  Tha  required  by  the  observer  is 

determined  through  psychophysical  experimentation  as  was  extensively- 
discussed  in  Ref.  2.  In  early  work  by  De  Vries  (Ref.  ?)>  it  was  assumed 
that  to  be  detectable,  the  image  must  equal  or  exceed  some 

threshold  constant,  i.e., 

SNRjjj  >  K.J,  =  SNRjyj  .  (62) 

Thi.s  was  verified  in  Ref.  2  with  the  typical  result  shown  in  Fig.  45  la 
the  form  of  probability  of  detection  vs  signal-to-noise  ratio.  The 
threshold  sigrial-to-noise  ratio,  SNE^p,  corresponding  to  a  50^ 
probability  of  detection,  is  very  nearly  a  constant,  independent  of 
image  size  for  most  of  the  image  sizes  of  interest  (the  exceptions  are 
noted  in  Ref.  2). 

As  pre-vj.ously  notea  in  Section  2.1,  it  is  hypothesized  that  an 
obser’rer  must  detect  the  pi'esence  of  a  single  bar  in  a  bar  pattera  to 
discern  the  presence  of  a  bar  pattern.  Thus,  £qs.  (59)  and  (6l)  apply. 


*  Assuming  continuous  presentation  of  the  scene  on  the  display. 
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Fig,  45  Corrected  Probability  of  Detection  vs  SNRjjj  r^equired  for 

Rectangular  Images  of  Size  04  x  4.  o  4  x  o4>  A  4  x  128  and 
O  4  X  180  lines , 

However,  it  is  usual  to  rewrite  Eq.  (6l)  in  the  form 
St.SAfy  i  T 

S'®DI  =  I  , 

2 

by  use  of  Eqs.  (2)  and  (3)  and  the  jn'ea  relation,  A  =  aY  . 

Again,  throiigh  psychophysical  experimentation,  the  threshold 
signal~to-noise  ratios  were  deterndned  with  the  typical  result  shown  in 
Fig.  46.  As  for  aperiodic  images,  we  note  that  the  SHRj^j,  is  approxi~ 
mately  a  constant  over  a  wide  range  of  spatial  frequencies.  The 
equations  above  apply  to  the  case  where  the  primary  noise  is  that 
generated  in  the  primary  photoconversion  process.  If  a  system  noise, 
such  as  preamp  noise  of  nas  value,  1^,  in  bandwidth  Af^^  is  added  sub¬ 


sequent  to  the  sensor  gain,  then 


Fig.  46  Threshold  SNIL.^  vs  Bar  Pattern  Spatial  Frequency  for  Display-to- 
Observer  Viewi^  Distances  of  O  14",  □  28"  and  •  56". 
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for  the  aperiodic  model  and, 

for  the  periodic  model.  In  both  cases,  the  added  system  noise  is 
assumed  to  be  white. 

Before  continuing,  we  note  that  many  analysts  and  experimenters 

choose  to  define  the  threshold  signal-to-noise  ratio  in  terms  of  the 
video  sir^';al-to-noise  ratio,  SNH^^.  For  the  periodic  jjnage  case,  this 

results  in  the  equation 
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Fig .  47  Threshold  Video  SNR  vs  Bar  Pattern  Spatial  Frequency  for  a 
Video  Bandwidth  of  lO'^  Hz.’ 
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For  t^  =  0.1  sec,  e  =  5,  Af^  =  10*^  Hz  and  a-  =  4/3>  =  l.l6  x  10"^ 

SNRjj,p  and  for  SKR^^p  =  2.8,  we  plot  the  SNR^q_.j;  in  Fig.  47.  This  curve 
or  some  variation  of  it  is  somebimeo  called  the  "eye  modulation  demand 
function."  The  inference  is  that  as  image's  spatial  frequency  increases, 
the  eye  "demands"  more  signal  modulation.  The  use  of  this  curve  is 
generally  to  be  deplored.  First  of  all,  if  the  spatial  frequency  of  the 
pattern  is  too  high,  the  observer  should  be  able  to  move  closer  to  the 
display  and  thereby  reduce  the  threshold.  But  the  thre&’cold  does  not 
decrease.  Furthermore,  instead  of  a  single  number  for  a  threshold,  a  cur\'’e 
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becomes  necessary.  Finally,  system  parameters  become  cixed  with 
observer  paraneters  >diich  is  an  inconvenience  when  observer-display 

interactions  are  to  be  considered. 

With  this  short  review  of  the  elementary  model,  we  proceed  to  the 
treatment  of  finite  aperfcvires. 

3-2  The  Effect  of  Finite  Apertures  on  Image  Detail 

If  an  imaging  device  were  perfect,  a  point  source  would  appear  as  a 

point  in  the  image's  plane.  If  this  were  so,  all  images  would  be  trans¬ 
mitted  through  the  device  with  perfect  fidelity.  In  reality,  images  will 
differ  from  the  object  in  amplitude,  shape  or  phase  (position)  or  all  three. 
These  image  changes  are  due  to  finite  imaging  apertxires  such  as  those 
associated  with  a  lens,  a  fiber  optic  faceplate,  an  electron  scanning  beam, 
a  phosphor  particle  and  the  like.  In  the  case  of  a  lens,  the  limiting 
aperture  may  be  the  lens  diameter  or  .in  Iris  placed  before  it.  In  a 
fiber-optic  faceplate,  it  is  the  diameter  of  the  fiber  itself.  Whatever 
their  form  or  cause,  their  effect  is  to  smear  image  detail  in  a  manner 
analogous  to  the  filtering  of  electrical  signals  by  electrical  filter 
networks . 

To  illustrate  the  effect  of  an  aperture,  consider  tht  point  source 
object  of  Fig,  A.8(a).  Due  to  diffraction,  chromatic  and  geometric 
aberrations,  and  imperfect  focusing,  the  point  will  be  imaged  by  the  lens 
as  a  blur.  A  line  source  as  shown  in  Fig.  48  (b)  will  be  similarly 
blurred.  An  equation  repi'esenting  the  image  intensity  vs  the  x,  y  coordi¬ 
nates  in  the  image  plane  is  known  as  the  point  spread  fxmetion  or  impulse 
response.  For  the  line,  the  one-dimensional  equation  is  Imown  as  the  line 
spread  function.  The  line  spread  case  corresponds  most  directly  to  the 
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Fig.  48  Effect  of  an  Aperture  on  a  Point  and  Line  Source  Imago. 

radio  communications  case  vihere  the  signals  vary  only  in  amplitude  and  time. 

However,  the  two-dimensional  aspects  of  a  point  image  do  not  impose 
unusual  conceptual  difficulties. 

A  linear  aperture  is  one  which  has  a  response  to  several  input  signals 
acting  simultaneously,  that  is  identical  to  the  sum  of  the  responses  that 
each  signal  would  produce  individually.  This  property  of  linearity  leads 
to  considerable  simplification  in  the  nathemaiical  description  of  such 
phenomena.  In  particular,  it  becomes  possible  to  decompose  complicated 
input  signals  to  simpler  signals  for  which  the  system  response  is  known 
and  then  find  the  total  response  by  summing  the  individual  responses  in 
linear  combination.  Furthermore,  we  can  then  use  Fourier  analysis  in 
which  the  complicated  input  signals  are  decomposea  to  sine  and  cosine 
waves. 

The  Foixrier  transform  of  a  complex  function  f(x,y)  of  two  independent 
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variables,  x  and  y,  is  given  syniboli<;;il3y  by  F(k^,Ky.)  and  is  defined  by 


CO 

JJ f(x,y)exp[-  .32n(k^  4-  kyy)]dxdy  . 


(67) 


The  complex  quantities,  k  and  k  ,  ai*e  reierred  to  as  spatial  frequencies 

X  y 

and  are  also  independent.  The  original  function,  f(x,y),  can  be  recovered 
by  taking  the  inverse  Fourier  transfom  as  follows 


w 

f(x,y)  =  JJ  F(k^ky)exp[j2n(k^  +  kyy)]dk^dky 


(68) 


Some  further  properties  of  the  Fo^rrier  transform  are  discussed  in  Reference 

8  but  a  general  familiarity  with  Fourier  teclmiques  is  assumed. 

One  of  the  most  important  imagtiig  system  test  objects  is  the  point 

source.  In  more  glamorous  terminology,  the  ;;oirit  source  is  known  as  the 
Dirac  delta  function,  the  unit  volume  impulse  or,  the  zero  order  singularity 

test  function.  Symbolically,  it  is  designated  6^(x  -  x^,y  -  y^)  and  has 
the  property  of  being  of  infinite  amplitude  at  xy  -  Xj ,  y]_  and  zero  every¬ 
where  else .  Also, 


00 


-  X]_,y  -  y3_)dxdy  = 


1.0  , 


(69) 


and,  the  Fourier  transfom  of  ^^(x  -  x^,y  -  y^),  is 


F(k^,ky)  =1.0  .  (70) 

That  is,  the  frequency  response  of  the  Dirac  delta  function  is  unity 
e’/erywhere  in  frequency  space.  Thus,  the  Dirac  delta  function  can  be 
thought  of  as  a  point  image  of  infinite  amplitude  but  finite  volume  in 
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x,y  space  and  of  uno-form  distribution  in  spatial  frequency  space  over  all 

frequencies.  This  frequency  distribution  is  often  known  as  a  white  spectrum. 

The  response  of  any  finite  aperture,  be  it  a  lens,  photosurface, 

electron  beam,  or  vdiatever,  to  the  Dirac  delta  function  is  designated  r^(x,y) 

in  the  space  domain  and  R  (k  ,k  )  in  the  Fourier  spectrum.  The  quantity 

0  X  y 

rQ(x,y)  is  the  point  spread  function  or  impulse  response  and  R^(k^ky.)  is 
known  as  the  optical  transfer  function,  or  OTF,  or  alternatively  as  the  com- 
olex-steady-state-frequency  response.  If  either  r^(x,y)  or  si^e 

knc'/m,  then  the  aperture's  response  to  any  input  test  signal  can  be 
determined,  i.e.,  these  functions  completely  specify  the  parameters  of 
the  aperture.  In  general,  the  OTF  may  be  written  in  the  form 


(■/-.) 


The  quantity  iR  (k  k  )[  has  been  designated  the  modulation  transfer  function, 
*  0  X  y  • 

or  MTF,  and  (f(k  ),  the  phase  transfer  function,  or  PTF. 

.  X  y 

ir  image  intensity  distributions  are  analyzed  by  Fourier  means, 
it  is  the  practice  to  nonna?aze  the  frequency  distribution  in  the  following 
manner.  Suppose  the  intensity  distribution  is  g^(x,y),  then  the  normalized 
spectrum  is 


G(k^,k  )  = 

x'  y 


G^(o7o; 


(72) 


where 


G^(o,c) 


g^(x,y)dxdy 


•XO 


(73) 


as  can  be  seen  from  Eq.  (67).  The  normalization  of  the  spectra  by  their 
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"zero  frequency"  values  is  partly  fc’  convenience  but  has  a  fundamental 
reason.  Since  intensity  is  a  non-negative  quantity,  an  ijitensity  distri¬ 
bution  always  has  a  non-zero  "dc -component"  or  constant  background.  The 
visual  quality  of  an  image  is,  to  a  large  extent,  dependent  on  the  contrast 
or  relative  intensities  of  the  information  bearing  portions  of  the  image 
above  or  below  the  ever  present  background  and  hence,  the  spectra  are 
normalized  by  that  background  (Ref.  8).  The  OTP  is  also  normalised  and 
has  a  value  of  unity  at  zero  frequency.  Also,  the  con, -Jugate  cf  the  OTF, 

R  *(k  k  )  =  R  (-Ic  ,-k,)  and,  the  value  of  the  OTF  at  frequencies  above 
zero  is  always  less  than  mity.  These  conditions  are,  of  course,  properties 
of  linear  apertures  and  do  not  apply  to  non-linear  elements. 

It  is  further  noted  that  while  the  OTP  is  always  unity  at  zero 

frequency,  it  is  not  implied  that  the  absolute  intensity  level  of  the 
object  is  the  same  as  the  absolute  intensity  of  the  object's  image. 

In  the  case  of  a  lens,  the  absolute  image  intensity  level  is  always 
less  than  that  of  the  scene  due  to  the  lens'  finite  entrance 
aperture;  a  decrease  which  is  not  evident  in  the  OTF  because  of  the 
way  OTF  is  normalized. 

In  the  general  discussion,  •spatial-  frequency  has  been  expressed  in  line 
pairs  per  unit  distance.  Usually,  either  k^  or  k^  are  given  in  ''Ine 
pairs/mm.  This  is  sometimes  a  convenience  in  specifying  the  OTF  of  a  lens 
which  can  be  used  with  a  nximber  of  film  formats  and  because  film  OTP's 
are  often  given  in  the  same  units.  In  more  complex  systems,  where  a 
number  of  imaging  and  re-imaging  steps  may  be  involved,  the  line  pair/mm 
units  are  not  so  handy.  For  example,  in  a  lovr-light -level  television 
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camera,  the  input  image,  t^e  image  at  the  output  of  the  intonsifier,  the 
image  at  the  gain-storage  target  and  the  displayed  image  may  all  be  a 
different  size.  One  of  the  principal  merits  of  describing  various  aperture 
responses  in  the  freq\iency  domain  :'s  that  the  overall  response  of  a  number 
of  apertures  in  cascade  can  be  determined  by  simple  multiplication  of  the 
individual  responses.  However,  when  image  magnifications  and  minifications 
are  involved  as  jn  the  LLLTV,  direct  multiplication  is  not  possible  — 
a  scale  change  must  be  made  at  each  OTF  interface. 

The  scale  change  complexity,  due  to  changes  in  pictxire  size,  can  be 
avoided  by  expressing  resolution  in  te>vns  of  the  picture  height.  This  is 
true  in  TV  practice  vdiere  the  specific  units  used  are  lines  or  half  cycles 
per  picture  height.  In  the  following,  we  will  use  the  TV  nomenclature 
except  when  otherwise  specified.  To  avoid  confusion,  we  will  give  the 
symbol  N  to  resolution  expressed  in  these  terms.  For  this  case,  the 
Fourier  transform  pair  equations  become 

00 

F(N^,Ny)  =  Jj*  f(x,y)  •  exp[-  2n(N^  +  Nyy)]*dx.dy  (74) 

00 

f(x,y)  =4/1*  exp[jn(N^x  +  Nyy)>dN^dNy  ,  (75) 

when  results  are  plotted  in  tercio  of  K,  lines  per  picture  height,  they 
can  be  converted  to  line  pairs  per  millimeter  at  any  point  using  the 
formula 


k  =  N  /2Y 
x  X 


(76) 


vdiere  Y  is  the  picture  height  in  ram. 


Another  ;mit  of  interest  is  the  angular  measure,  kg,  which  is 
spatial  frequency  expressed  in  line  pairs  per  miUlradian  which  is  related 
to  N  by 


k,-  = 


N  • 

X 


ex  2000Y  * 


(77) 


vdiere  is  the  lens  focal  length. 

To  clarify  these  measures,  suppose  that  a  repetitive  bar  pattern 
is  projected  onto  an  image  pxane.  Let  the  bar  pattern  spacing  be  Ay  in 
mm.  The  spatial  frequency  k  is  the  number  of  cycles,  equal  to  2Ay  in 
length  which  can  be  fitted  into  1  mm.  Thus, 

k  =  .  (73) 


If  the  picture  height  is  Y  mm,  n  is  the  number  of  half  cycle*'  equal  to 
hy  In  length  that  can  be  fitted  into  Y,  i.e., 


N  -  Y/Ay  <  (79) 

The  angular  subtense,  AS,  of  Ay  in  mr,  with  a  lens  of  focal  length, 
is  lOOOAy/Fj^.  The  spatial  frequency  kg is  the  number  of  cycles  of  length 
2A6  which  can  be  fitted  into  a  milliiadian.  Thus, 

F 

u  _  -1_  _  L 
“  2A0  ~  aOOOAy  ' 

In  general,  k*will  be  used  only  to  describe  overall  sensory  system 
resolution. 
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An  aperiodic  object,  as  used  here,  is  an  isolated  object  viewed 
against  a  uniform  background  of  large  extent.  For  practical  purposes, 
a  background  can  be  considered  to  be  of  large  extent  when  the  object  is 
sufficientljr  far  removed  from  other  objects  so  that  the  image  of  the 
object,  after  being  smeared  out  by  the  apertures  through  which  it 
passes,  does  not  become  additively  combined  with  the  smeared  out  Images  of 
other  objects  in  the  viewed  scene. 

The  general  nomenclature  we  shall  use  for  analysis  of  one-dimensional 
objects  is  shown  in  the  functional  diagram  of  Fig.  49.  In  the  space 
domain,  the  input  signal  is  k^f(x),  the  aperture  is  r^Cx)  and  the  output 
is  kj^g(x)  where  g(x)  is  the  convolution  of  r^(x)  and  f(x),  i.e., 

g(x)  r^(x)^f(x)  .  (81) 
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Fig.  50  Illiiatration  of  the  Effect  of  an  Aperture  of  Effective  Duration 
xVa  »  1.0  on  a  Rectangular  input  Image  in  Both  the  Space  and 
Fourier  Danaina  for  -  2.0. 

Similarly  in  the  spatial  frequency  domain 


G(n;  =  R^(N)  •  F(N)  , 


where  G(N),  Rq(N)  and  F(N)  are  the  Fourier  transforms  of  g(x), 
r^(x)  and  f(x).  These  processes  are  illustrated  graphically  in  Fig.  50 
for  the  special  case  of  a  rectangular  input  signal  and  a  Guassian  aperture 
of  the  mathematical  form 


j(x)  =  [^exp[-  |(J)^]]/(2to^)^  , 


RqCn)  =  exp[-  (mN)V2]  . 
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A  imit  amp'^itude  rectEmgular  input  image  can  be  described  by  either 


or 


ay  ^  2 


sin(TTyNx  /ay) 


(85) 


(86) 


The  effect  of  passing  the  above  rectangular  image  through  the  Guassien 
aperture  of  Eqs.  (83  and  84.'  above  is  illustrated  in  Fig.  50  for  the  case 
of  x^cy  “  2.  For  this  case,  the  input  signa3.  is  near  the  same  size  as 
the  aperture,  so  the  aperture  has  a  pronounced  effect  on  it. 

The  Fourier  spectra  of  pulses  of  vddth  x^cy  =  8  and  4  are  shown 
along  with  Rq(N)  for  the  assumed  Guassian  aperture  in  Fig.  51-  It  is 
seen  that  the  MTF  should  have  little  effect  on  the  pulse  of  width  8 
bub  a  more  pronounced  effect  on  the  pulse  of  width  4.  This  is  isi  fact 
the  case  as  can  be  seen  in  Fig.  52  where  the  output  wave  shapes  for 
various  pulses  of  width  x^a'=  l6,  8,  4  and  1  are  shown.  The  outputs 
pulses  are  plotted  as  dashed  curves  while  the  input  pulses  are  plotted 
as  solid  curves.  It  is  seen  that  as  the  input  pulses  become  progressively 
smaller,  the  first  effect  is  to  roimd  the  output  pulse  c^'mers  leaving 
peak  amplitude  unchanged.  As  the  input  pulse  approaches  the  effective 
width  of  the  point  spread  function,  r^(v<y),  the  amplitude  decreases 
as  well.  The  change  in  pulse  amplitude  is  shown  as  a  function  of  the 
input  pulse  width  in  Fig.  53-  When  the  input  pulse  is  wide,  the  effective 
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Fig.  51  Fourier  Spectra  of  Unit  Amplitude  Rectangular  Input  Pulses  of 
Duration  x/a  -  &  and  A.  Also  shown  is  the  Optical  Transfer 
Function  for  a  Guassian  Impulse  Response  of  Effective  Duration 
V»  =  X. 


Output  Waveshape  is  Shovm  as  Dashed  Curve. 
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Fig.  53  Relative  Output  Pulse  Amplitude  vs  the  Width  of  a  Unit  Amplitude 
Rectangular  Pulse  after  Filuering  by  a  Guassian  Aperture  of 
Effective  Duration,  x Ja  »  1.0. 

width  of  the  output  pulse  is  almost  equal  to  that  of  the  input  pulse.  As 
the  input  pulse  becomes  very  narrow,  the  effective  width  of  the  output 
pulse  becomes  very  nearly  a  constant  independent  of  the  width  of  the 
input  pulse  as  can  be  seen  from  the  curve  of  Fig.  54.* 

In  the  elementary  theory  of  imaging,  it  is  assumed  that  the  eye, 
within  certain  bounds,  can  expand  its  limits  of  integration  as  necessary 
to  match  the  dimensions  of  a  displayed  image  and  that  the  perceived 
signal,  Sp,  will  be  proportional  to  the  area  of  the  displayed  image. 


*  In  plottin^^  the  effective  width,  it  was  assumed  that  the  width  is  equal 
to  the  widtu  of  a  rectangle  of  height  equal  to  the  output  pulse  amp3J,- 
tude  and  area  equal  to  the  output  (or  input)  pulse.  This  is  not  the 
noise  integration  distance  to  be  discussed  later. 


100 


Fig.  54  Squivalent  Output  Pulse  Width  vs  the  Width  of  a  Unit  Amplitude 
Rectangular  Input  Pulse  of  Width  x /v  After  Passing  Through  a 
Guassian  Aperture  of  Equivalent  Width  Xo/a  =  1.0. 


Specifically, 

s  =  K^t  J'  g(x)dx  ,  (8?) 

where  is  the  incremental  amplitude  of  the  input  pulse,  and  t  is  the 
integration  time  of  the  observer's  eye.  Observe  that 


G(N)  =  J  g(x)exp(-  ^Nx)dx  ,  (88) 

and  that 

CO 

G(q)  =  J  g(x)dx  .  (89) 

•<0 

That  is,  the  integral  over  the  output  area  image  is  equal  to  the  value  of 
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the  Fourier  transform  of  the  output  image  at  zero  frequency. 

We  further  note  that  from  Eq.  (79), 

G(o)  =  R^(o)  •  F(o)  (90) 

and  since  Rq(o),  the  vajue  of  the  OTF  at  zero  frequency  is  equal  unity 
by  definition,  G(o)  =  F(o)  and 

s  -  k-t  G(o) 

P  1  '  ^ 

=  k^t  F(o) 

CO 

=  k^t  J  f(x)dx  .  (91) 

-<0 

The  implication  of  the  above  result  is  that  the  area  under  the  output 

p\ilse  in  Fig.  50  is  identical  to  the  area  under  the  input  pulse  as  is 

also  shown  by  the  hatched  areas  in  the  figure.  Thus,  if  our  assumption 
concerning  the  spatial  inte;iratlng  capability  of  the  eye  is  correct,  the 

aperture  has  no  effect  on  the  perceived  signal,  i.e,,  as  the  image 

is  spread  out  by  the  aperture,  the  eye  merely  e^qjands  its  limits  of 

integration  to  include  all  of  the  signal. 

Whii.e  the  aperture  does  not  affect  the  perceived  signals,  it  can 

affect  the  perception  of  noise  added  either  prior  to  or  subsequent  to 

an  aperture.  To  begin,  assume  that  noise  is  added  after  the  image  has 

passed  through  the  aperture  as  shown  in  Fig.  55 •  Suppose  the  input  pulse 

is  rectangular  as  shown  by  the  dashed  lines  and  that  the  output  pulse  is 

smeared  out  as  shown  by  the  solid  curve.  In  general,  the  signal  must  be 

perceived  in  the  presence  of  noise.  If  the  pulse  had  not  been  smeared 

out,  the  eye  would  then  integrate  the  noise  only  over  the  distance  x^. 

However,  with  the  pulse  smeared  out,  the  eye  would  then  integrate  the  noi.se 
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Fig.  55  Increase  in  Noise  Perceived  by  an  Observer  due  to  an  Increase 
in  Effective  Image  Size  due  to  an  MTF  Preceding  a  Point  of 
Noise  Insertion 


/  2  2\i 

over  some  larger  distance;  perhaps  over  an  effective  distance  (x^  + 
as  shovfn.  Thus,  vrtiile  the  aperture  did  not  decrease  the  perceived  signal, 
nor  add  noise  of  its  own,  it  can  increase  perceived  noise  generated 
elsewhere  in  the  imaging  process.  We  note,  for  future  reference,  that 
the  effect  of  noise  added  before  an  aperture  is  less  serious  than  a  noise 
added  after  an  aperture  for  in  the  former  case,  the  apertvire  also  has 
a  filtering  effect  on  the  noise. 

In  the  treatment  that  follows,  we  shall  consider  the  eye  to  be  a 

perfect  integrator  in  space.  Assume  a  one-dimensional  image  with  a 

A2 

white  noise  background  of  uniform  variance  a  units  per  cycle.  Tlie 
noise  diagram  is  as  shown  in  Fig.  56.  For  the  noise  model,  we  will 
assume  the  relation 
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Fig.  56  Signal  and  Noise  Diagram  for  the  Case  of  an  Aperiodic  Image  vdth 
Noise  Added  Subsequent  to  on  Aperture. 


=  (K^)^t6/ABjj  (92) 

where  K  is  a  unit  conversion  constant,  t  is  the  integration  time  of  the 
sye,  6q  is  the  spatial  duration  of  the  image  and  is  the  noise 
equivalent  spatial  bandwidth.  The  duration  variable,  5^,  expresses  the 
notion  that  the  eye  integrates  the  image  along  the  width  of  the  image 
while  aBjj  expresses  the  notion  that  the  noise  is  bandlimited.  As  will 
be  seen,  the  output  image  waveshape  itself  determines  both  the  duration 
and  the  bandwidth  of  the  noise. 

We  define  the  duration  variable  to  be  the  integral  of  the  output 
image  divided  by  the  output  pulse  amplitude,  i.e., 

00  CO 


kg  /  g(x)dx  J  g(x)dx 
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With  these  results,  we  can  write 

,  ?  |P(N)E  (N)|^dN 

ft  2 ,  ij — 

^  e(of  |f(o)|2 


which  can  be  simplified  to 


=  (K^)^t  - 


]  |F(N)R  (N)|2dN 


g(o)' 


(94) 


(9:5) 


However,  we  shall  use  the  previous  form  of  Eq.  (94)  for  illustrational 
purposes . 

Suppose  the  input  image  is  a  rectangular  image  of  the  form 
given  by  Eq.  (85)  with  0  =  1.  When  the  input  Image  width  is  large 
with  respect  to  6^^  the  noise  equivalent  line  spread  width  of  the  aperture, 
and  as  previously  noted  in  connection  with  Eq.  (93) » 


The  bandwidth  is  given  by 


J  |G(N)j2dN 

|g(o)|2 


00 

J  |F(N)R^(N)|2dN 

|F(o)l^ 

then  g(o)  =1.0  and  F(o)  =  ss  can 
pulse  shown  in.  Fig.  52.  Also,  H^(N) 
the  spectrum  of  the  wide  piolse  shown 
duration  variable  becomes  x  and  the 
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be  readily  seen  for  the  wide  input 
will  be  =  1.0  as  can  be  seen  for 
in  Fig.  51.  The  result  is  that  the 
bandwidth  term  becomes 
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For  our  unit  amplitude  rectangular  pulse 


F(N)  = 


x^sinnNx^2 

trNxV? 


(100) 


Thus,  aBjj  =  :x,^,  and 


V  =  V  •  -t  ■ 


(Ml) 


The  root  mean  square  noise  becomes 


Sp  = 


(102) 


which  is  seen  to  be  simply  proportional,  to  the  square  root  of  the  image 
area  as  the  elementary  model  would  lead  us  to  believe. 

For  an  intuitive  feel  for  this  result,  we  note  (mce  more  that  for 
images  of  large  width,  the  duration  of  the  image  is  the  value  of  F(N) 
at  N  =  0  as  shown  in  Fig.  51.  The  bandwidth  is  determined  by  normalizing 
F(N)  by  dividing  by  F(o)  as  shown  in  Fig.  57.  Then  the  normalized 
function  is  squared  and  integrated  to  give  the  noise  equivalent  bandwidth 
as  is  also  shown  in  the  figure. 

We  next  consider  the  case  where  the  input  image  width  becomes 
small,  with  respect  to  the  width  6. of  the  noise  equivalent  line  spread 
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Fig.  57  Normalized  Function  F(K)/F(o)  vs  Spatial  Frequency  and 

the  Noise  Equivalent  Bandvddth.  ^ 

f\aiction.  As  the  input  image  v»idth  approaches  the  dimensions  of  an 

Impulse,  F(N)/F(o)  becomes  numerically  equal  tc  unity  (the  Fourier 

spectrum  of  an  impulse  is  a  constant  over  all  frequency) .  Therefore, 

g(x)  =  F(0)  J  1^'  cffl 


=  X  f  R  (N)e^  qN 
0  J  o 
o 


- 


(1P3) 


That  is,  the  output  waveshape  function  takes  on  the  shape  of  the 
aperture's  impulse  response.  Vfe  observe  that 


g(o)  =  x^r^(o) 


(104) 


Using  this  result  in  Eq.  (93), 
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(1D5) 


xhus,  the  output  image  duration  becomes  a  constant  which  is  numerically 
equal  to  the  inverse  of  the  impulse  response's  amplitude. 

This  result  may  become  somewhat  clearer  by  noting  that  the 
equivalent  impulse  duration,  6^,  as  defined  by  a  rectangle  of 
ampli'ude  equal  to  r^(o)  and  of  width  selected  so  that  r^Co)  •  6^  is 
equal  to  the  area  under  the  impulse  response,  is  numerically  equal  to 


J  rQ(x)dx 


so  that  6  -6.  for  the  infinitesimally  narrow  input  image. 

0  I 

As  we  noted  above,  F(N)/F(o)  becomes  approximately  laiity  as  the 
input  image  width  approaches  an  Impulse.  Hence,  the  noise  equivalent 
bandwidth  becomes  simply 


(106) 


ABjj  =  J  R/(N)dN 


(10?) 


which  is  numericallv  equal  to  Sohades,  N  ,  the  noise  equivalent  band- 

© 

width,  for  an  aperture.  Then,  the  mean  square  noise  becomes 


(108) 


The  noise  equivalent  bandwidth,  N^,  is  equal  to 


. .  -  • 


N  = 

®  «e 


(109) 


where  6^  is  the  noise  equivalent  aperture.  Since  6.  is  not  far 
different  from  f,  ,  the  nna  noise  bec<aies 

jL 


ftp=  (K())(t8p^ 


(110) 


and  therefore,  the  rms  noise  is  proportional  to  the  square  root  of  the 
noise  equivalent  apertxire  as  the  input  Ijaage  becomes  very  small. 

Again,  to  develop  an  intuitive  I'oel  for  this  result,  we  note  that 
for  a  small  image,  the  output  pulse  spectrum  assumes  the  form  x^R^(N) . 

The  noise  equivalent  bandwidth  is  determined  by  squaring  Rq(N)  and 
integrating  to  give  aBjj  in  a  manner  directly  analogous  to  that  used  in 
obtaining  aBj^  of  Fig.  57. 

While  the  equations  above  for  the  limiting  cases,  (either  very  large 
or  very  small  input  Images)  are  easy  to  use,  majiy  input  images  of 
interest  fan  between  these  extremes.  To  simplify  the  handlir.g  of  these 
cases,  we  shall  assume  that  both  the  input  image  and  the  aperture  have 
Guassian  waveshapes.  Let  the  Fourier  spectrum  of  the  input  pulse  be 


rr  t  N  \< 
ex 


(111) 


and  let  thf  aperture ' s  Fourier  spectrum  be 


The  noise  equivalent  bandwidth  for  the  overall  ijnage  is  given  by 


|P(N)RQ(N)|^dN 

P(o)^ 


CO 


=  J  exp  - 
0 


2_ 

Jrr 


w  ^ 

J  expends 

0 


u 


In  trrms  of  the  noise  equivalent  apertures. 


(115) 


For  Ouassian  waveshapes,  the  overall  noise  equivalent  aperture  of  a  number 
of  apertures  in  cascade  can  therefore  be  determined  from  the  component 
apertiu’es  added  in  quadrature.  Ehrer.  when  the  input  image  waveshapes  and 


110 


apertures  are  not  Guassian,  the  npproodjnation  can  be  used  vdth  little 
error.  If  the  Input  image  is  rectangular  of  duration,  x^,  as  In  the 
examples  above, 


(116) 


A  further  appi'oximation  is  that  the  duration  variable,  of  Eq.  (91) 
above  crrx  also  be  approximated  by  6^^.  Then, 

(117) 

(ns) 


and 


^  eo 


ftp  =  K^(t6gg)^ 


New  suppose  first  that  the  input  wave  shape  is  reotangulai  so  thet 
6  =  X  and  that  the  physical  aperture,  6  ,  is  zero.  Then, 

6X  0 


A 

p 


(n9) 


The  ratio  of  Eq.  (118)  and  the  above,  is  desigiiated  the  noise  increase 
fac'-or,  i.e.. 


(no) 


in 


kgfCx) 


kgfCx) 


Ro(ll) 


Noise 


Fig.  58  (a)  Aperture  Follovdng  a  Point  of  Noise  Insertion,  and 
(b)  Functional  Noise  Diagram  for  (a). 


Using  this  noise  increase  factor,  the  Eq,  (UB)  may  be  written  as 


ftp  =  K$(t^x^)' 


which  will  be  a  convenience  in  subsequent  analyses. 

We  next  consider  the  case  where  the  aperture  follows  the  point 
of  noise  insertion  as  shown  in  Fig.  58(a).  In  this  case,  the  aperture 
function,  r^(x),  can  both  increase  the  perceived  noise  by  increasing 
the  noise  integration  distance  and  decrease  it  by  virtue  of  a  filtering 
action.  Ixa  the  previous  case  (noise  added  after  the  aperture),  the 


noise  in  the  image  is  white  in  character  (though  spatially  bandlimited) . 

In  the  case  now  under  consideration,  the  displayed  noise  will,  have  a 
finite  spectrum  due  to  passing  through  the  aperture. 

Conceptually,  the  processes  will  be  assumed  to  be  of  the  following 
nature.  The  input  image  is  first  passed  through  the  a-perture  s? 
as  to  increase  the  noise  integration  distance.  Next,  the  noise  is 
band  pass  limited  and  added  to  the  output  signal  as  shown  in  the  functional 
noise  diagram  of  Fig.  5S(li).  For  later  convenience,  we  will  first 
assume  that  the  noise  source  follows  the  aperture  in  which  case 
Eq.  (91)  above  applies,  i.e., 

=  (K^)^t5/A%  (3^2) 

except  that  the  subscript  W  has  been  added  to  to  indicate  the  white 
character  of  the  noise.  To  correct  for  the  f,in:’.te  noise  spectrum, 
we  wi’ite 


A  2  2.n  , 


(123) 


where  r  is  the  correction  factor  for  a  finite  noise  spectrum.  The 
noise  bandwidth,  is  given  by 


CO  jG(N)R^(N)rdN 

ABj^f  ""  J  ^7T2 

0  F(  0,) 
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(124) 


(125) 


(126) 


(127) 


(128) 


(129) 


(130) 
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The  noise  increase  factor,  is  a  nmnber  larger  than  one  while  the 
noise  correction  factor,  r*  is  less  than  one.  However,  the  product 
is  greater  than  one.  Hence,  the  effect  of  an  apertxire  following 
a  point  of  noise  insertion  is  to  increase  noise  but  by  an  amount  less 
than  if  the  aperture  preceded  the  point  of  noise  insertion. 

Before  continuing,  we  note  that  the  general  formulation  for  this 
case,  corresponding  to  Eq.  (99)  for  the  previous  case  is  given  by 


|F(N)R^^(N)|^dN 

g(o)^ 


(131) 


To  complete  this  discussion,  we  consider  the  case  of  two  apertures 
with  two  points  of  noise  insertion,  one  noise  following  the  first  aperture 
but  preceding  the  second  and,  the  other  noise  at  the  output  of  the  second 
aperture  as  shown  in  Fig.  59.  To  begin,  we  assume  the  two  noises  to  be 
and  np2*  If  the  apertures  did  not  exist,  then  the  two  noise  sources 
may  be  assumed  to  add  in  quadrature,  i.e.. 


*  2  A  2  A  < 

%  -"V 


(132) 


If  the  input  image  is  re. .^angular  with  duration  and  if  both  noise 
sources  are  white,  then 


(133) 


Both  apertures  increase  the  noise  integration  distance  by  an  amount  ^ 
where 
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Fig.  59  Apertures  Which  Both  Follow  and  Precede  Points  of  Noise  Insertion. 


^  =  [H- 


(334) 


where  6^^  and  are  the  noise  eqxiivalent  apertures  of  the  first  and 
second  aperture  respectively.  Since  the  first  noise  source  precedes 
the  second  aperture,  the  first  noise  must  be  corrected  for  a  finite 
noise  spectrum.  Tlie  correction  factor,  F,  is  equal  to 


r  == 


xLT 


[1  +  ^ 

^0  "0 


(135) 


and  the  noise  becomes 


%  C(k2.«^l)  r  + 


(136) 


ll6 


Both  noises  are  increased  by  the  noise  increase  factor,  but,  the 
noise  which  precedes  the  second  aperture  is  filtered  by  it. 

We  turn  next  to  the  effect  of  apertures  on  periodic  images. 
A  one-dimensional  pattern  such  as  the  conventional  bar  pattern  is 


aperiodic  along  the  bars  and  periodic  in  the  direction  transverse  to  the 
bars.  Consequently,  the  analysis  above  applies  along  the  bars  but  changes 
are  needed  in  the  periodic  direction.  If  the  input  to  a  linear  sensor 
is  periocLi.c,  the  output  will  also  be  periodic.  The  output  and  input 
periods  (frequencies)  will  also  be  identical. 

We  suppose  first  that  the  MTF  precedes  the  point  of  noise  in¬ 
sertion.  Then,  the  primary  effect  of  the  apertures  will  be  to  decrease 
the  signal  modulation.  Since  the  period,  or  noise  integration  distance 
is  unchanged  (at  least  for  the  higher  spatial  frequencies)  the  per¬ 
ceived  noise  is  unaltered  as  well.  According  to  Schade,  the  mean  signal 
associated  ■jfith  a  bar  pattern  of  spatial  frequency  N  after  the  bar 
pattern  has  passed  through  an  aperture  of  MTF,  Ry(N)  is  given  in  terms 
of  a  square  wave  flux  response  Rgp(N)  which  is  numerically  equal  to 


Rgp(N)  =>  -^  S  ”2~  ^ 

TT^  k  =>  1  K 


(137) 


If  the  MTF  precedes  the  point  of  noise  insertion,  the  typical,  elementary 
SNHjj  equation  [see  Eq.  (A)]  becomes 


=“4. "  [f] 


ru-ji  ^ 


_ n  a.v _ 

-  -  SL  _ 

^av 


(138) 
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In  the  above,  we  have  ignored  the  effect  of  the  apertures  along  the 
length  of  the  bars. 

When  the  aperture  follows  a  point  of  noise  insertion,  the 
aperture  also  filters  the  noise  as  it  did  in  the  aperiodic  case.  The 
noise  f ilte  >  ing  function  for  the  periodic  case  is  given  by 


e(N)  = 


l"  |R/(N)|dN 
N 


(139) 


This  factor  multiplies  only  the  noises  introduced  prior  to  the  location 
of  the  aperture.  For  example,  the  MTF  of  the  sensor  |R^,p(N)|  would 
usually  filter  the  photoelectron  noise  of  Eq.  (139)  but  not  the  preamp 
noise.  Then,  Eq.  (139)  becomes 


rtcli  W!!  "V^av 

"UJ  N  f~r  ^  ^  • 


(140) 


3.3  FU’fect  of  Apertures  on  Signal-to-Noise  Ili'tio 

We  have  derived  and  discussed  the  effect  of  fini.te  sensor 
apertures  on  image  waveforms  and  noise,  in  some  detail.  We  now  combine 
these  effects  with  the  elementary  sensor  model.  For  this  purpose, 
we  rewrite  Eq.  (64)  below  as 


2GtCj^ 


av 


®^av 


+  V/2Af^ 


(141) 


■  'hich  was  derived  for  a  sensor  with  only  two  noise  sources;  photo¬ 
electron  noise  and  preamp  noise.  A  typical  sensor  of  this  type  is  shown 
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Fig.  6o  Schematic  of  an  EBSTC®!  Camera  Tube. 

in  Fig.  60.  The  lens  repiresents  an  aperbure  preceding  the  point  of 

photoRlectron  noise  insertion  (at  the  input  pljotocathode)  ■while  the 
target  follows  the  photoelectrcn  noise  input  but  prec^es  the 

preamp  noise  introduced  at  the  target  lead.  The  lens  MTF  is 

designated  Rq^CN)  and  the  target  MIF  is  . 

The  effect  of  the  apertures  on  an  aperiodic  object  is  to 

increase  the  noise  leaving  signal  unchanged.  The  lens  increases  the 
*  *  *  ,  -  .  . 

percei'ved  photoelectron  and  preamp  noise  as  does  the  target,  but  the 
target  also  has  filtering  effect  on  the  photoelectron  noise.  Quantita¬ 
tively, 


t.e  1  ,  2G-,CLi^ 

SWip  =  [-^]^  - i— T- - 2 - - r  (2A2) 
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where  iy^  =  V  ^  ^  ^x’  ^y 

and  r  is  given  by  Eq.  (128) .  For  one-dimensional  bar  patterns, 
both  the  lens  and  target  reduce  signal  modulation  while  the  target 

has  a  filtering  effect  on  noise.  These  effects  are  Included  in  the 
equation  below  as 

_ _ ^T^^av _ 

Kyi,T(ii)]i  •  s  [G/erj^(K)i^^  +  ipVaify]^ 

where  Rgp(N)  is  given  by  Eq.  (139). 

In  this  section,  a  theory  of  the  effects  of  apertures  on  image 
detectability  has  been  presented  for  stationsuT  images.  In  the  next 
section,  the  effects  of  image  motion  are  included  and  in  section  5>  the 
preliminaiy  attempts  to  verify  the  theory  of  ai)eriures  experimentally 
will  be  discussed. 


=  [-^3^  • 


04^ 
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4.0  Effects  of  Image  Motion 

Except  when  an  object  moves  relative  to  a  stationary  background, 
relative  scene/sensor  motion  is  degrading  to  image  quality.  These  degrading 
effects  can  be  divided  into  three  distinct  mechanisms;  the  effect  of  the 
motion  on  the  observer  directly,  the  interaction  of  image  motion  and  camera 
exposure  time,  and  sensor  time  constant  effects.  These  various  effects  were 
previously  considered  in  Ref.  2  in  some  detail  and  will  be  further  considered 
herein.  Ir.  general >  the  effects  of  image  motion  on  the  observer  are 
considered  to  be  laearly  negligible  for  the  image  motion  rates  commonly 
encountered  in  television  practice,  the  interaction  of  image  motion  and 
exposure  time  is  considered  to  be  quite  serious  as  can  be  discerned  from 
the  analytical  treatment  in  Section  2  of  this  report.  Also,  sensor  tim3 
constancs  can  be  limiting  to  system  sensitivity  and  dynamic  range. 

In  this  section,  motion  experiments  were  performed  to  test  the  validity 
of  certain  of  the  image  motion  concepts  and  to  gain  further  insight  into 
the  image  motion  problem.  Specifically,  psychophysical  experiments  were 
performed  using  moving  bar  patterns  and  the  complex  images  (vehicles)  used 
previously  in  the  recognition  experiments.  The  vidicon  camera  was  used  to 
generate  the  imagery.  In  these  experiments,  the  light  level  was  high 
enough  so  that  sensor  time  constants  are  nearly  negligible  and  the  primary 
effect  of  motion  is  due  to  exposure  time.  Finally,  further  analysis  was 
performed  on  sensor  lag  data  previously  taken  for  the  purpose  of  improving 
the  analytical  sensor  models. 


Continuous  Strip 


Lens 


Light  Box 


H 

Motor  Driven 

0 

Vidicon 

h_ 

d 

Fig,  61  Experimental  Set  Hn  for  Motion  Experiments 


For  bar  patterns,  the  current  notion  MTF  model  was  used  (notion  effects 
oniy-not  lag) ,  and  it  appears  to  be  adequate  for  the  particular  case 
considered.  For  the  vehicular  imagery,  an  aperiodic  model  was  applied  with 
apparent  success  but  the  results  must  be  considered  tentative.  The  sensor-lag 
effects  were  and  still  are  the  most  difficult  to  model  although  some 
correlations  between  observed  image  degridation  and  lag  measurements  are 
becoming  apparent. 

4.1  Psychophysical  Experiments  Involving  Image  Motion 

The  expiirimental  set-up  which  was  used  for  the  motion  experiments  is 
shown  in  Fig.  61.  A  continuous  strip  of  35mm  film  was  moved,  at  a  constant 
speed,  past  the  vidicon  camera.  Speed  could  be  varied  from  less  than  60 
seconds  per  picture  width  to  faster  than  5  seconds  per  picture  width.  Motion 
could  be  either  from  left-to-right  or  right -to-left.  For  the  experiments 
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with  vehicle  imagery  reported  here,  «•  film  speed  of  10  sejonds  per  picture 
widv.h  was  used  and  the  motion,  as  seen  on  the  monitor,  went  from  left  to 
right.  Four  vehicle  images  were  used,  a  tank,  a  Vvan  truck,  a  track  with  a 
radar  antenna  on  top  and  a  mobile  derrick  with  a  bulldozer  blade.  The  order 
of  the  images  on  the  film  was  randomly  chosen  as  was  the  signal-to* noise 
ratio  of  the  image.  Three  observers  participated  in  the  experiment.  A  total 
of  600  data  points  were  taken. 

Display  signal-to-noise  ratio  was  calculated  as  follows.  The  broad 
area  form  of  the  SNRp  equation  is  used  and  for  convenience  it  is  repeated 
here  es 


SNR 


DI 


•-1  2t  Af 

d  _ 


SNR, 


(144) 


where  t  =  0.1,  Af^  =  12.5  x  10^  Hz  and  SNR^,  is  the  peak-to-pcak  signal 
voltage  (with  image  motion)  In  the  image  divided  by  the  RMS  noise  voltage. 

The  value  of  a/A  that  was  used  was  the  area  of  the  image,  a,  on  the  photo- 
sun  ace  divided  by  the  active  at?.a  of  the  photocurfece,  A,  assuming  a  perfect 
lens  with  no  MTF's  effo.ots.  The  factor  of  In  the  equation  comes  from  the 
assumption  that  we  are  to  calculate  SNR^^  of  an  equivalent  bar  pattern  basis, 
that  id,  for  recognition,  the  bars  are  each  a/8  in  area  (see  Fig,  3  of 
^(action  2).  In  Table  8,  the  values  of  a/A  and  the  unattenuated  SNR^  values 
are  listed  for  the  images  which  wei-e  used  in  this  experiment. 

In  Tig.  62,  the  calculated  values  of  SNR^  are  plotted  as  a  function  of 
corrected  probability  for  the  four  images.  The  average  SNRjj_^  value,  at  the 
oO/o  p-~obabiiicy  level  is  5.9.  This  is  30%  higher  than  that  which  was 
obtained  for  the  same  targets  when  stationary. 
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Target 

(a/A) 

SNRy 

(Zero  db  Level) 

Tank 

.000702 

1 

Derrick 

.000514 

.95 

Truck 

.000649 

.80 

Radar  Truck 

.000602 

.90 

Average  a/A  =  .000615 


Table  6  Values  a/A  and  Used  for  Motion  Sxperiinent 
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The  above  calculations  ignored  the  MTF's  associated  with  the  lens,  the 
camera,  the  interaction  of  camera  exposure  time  and  image  motion.  In  the 
following  these  MTF's  will  be  included  in  the  SNRjjj  calculation  by  using 
the  aperiodic  form  of  SNRpj  as  developed  in  Section  3. 

The  aperiodic  form  of  is 


SNR^i== 


2t  afy  a 

I  I 

^‘LT  ^'lT  ^ 


SNRy 


(145) 


where  f  (  account  for  the  ircrease  in  the  perceived  noise  due  to  the 
^LT  ^LT 

spreading  of  the  image  by  the  various  MTF's.  If  the  width  of  the  actual 

image  is  x  and  the  length  is  y  ,  then  ?  I  is  given  by 
°  °  ’^T  ^LT 


'LT 


XT 


1  + 


fe)  •(?)•(?)  ■  •(;;)•(?)' 


(146) 


;diere  the  subscripts  L,  T  and  M  refer  to  the  lens,  camera  cube,  and  motion 
respectively.  The  valv'es  of  5^^,  and  are  calculated  from 


N 


oL 


8  =  - 
T  N 


eT 


/iKoL<  ® 

1 


(147) 


(148) 


(149) 


JN 


and  the  rest  of  the  terms  are  as  before. 


In  Table  7,  the  values  of  6^,  5_,,  8  ,  x  ,  y  ,  ,  and  P.  that  are 


LT 


XT 


used  for  calculating  Eq.  (145)  are  listed.  There  was  some  vibration  in  our 
experimental  set  up  due  to  the  blower  on  the  light  bax  and  an  estimate  of 
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Condition 

X 

o 

1 

L  J 

Parameter 

5m 

^\t 

^  y 
^LT 

Static 

2.53x10“3 

HRRRB 

4.11x10-3 

0 

1.93 

1.01 

Motion 

2.53x10-3 

4.05x10-2 

1.17x10-2 

4.11x10-3 

5.34x10-3 

5.43 

1.05 

Table  7  Parameters  Used  in  Calculating  SNR^  for  Aperiodic  Target 


the  overall  MTF  of  the  lens,  including  this  vibration,  was  made  from  the 
static  square  v;''ve  response  of  the  systems  with  the  blower  on.  This  data 
is  shown  in  Figure  63. 

Using  the  numbers  from  Table  7,  we  find  that,  statically  SNRjj_j  *  2.2 
whereas  dynamically  SNRjj_.j,  “  2.5  .  ’’he  two  results  are  nearly  the  same  and 
their  difference  is  well  within  a  reasonable  experimental  error. 

To  continue,  we  will  show  that  the  measured  dynamic  pattern  square 
wave  response  is  only  slightly  smaller  than  that  obtained  by  multiplying 
the  sensors  static  square  wave  response  times  the  sine  wave  response  for 
linear  motion  assuming  complete  sensor  integration  for  one  frame  time 
(1/23  sec  here).  Assume  that 

■  '>0  '‘sq'")  <150) 

where  RgQj.j(N)  is  the  dynamic  square  wave  response,  Rgp(N)  the  static  square 
wave  response  of  the  sensor,  and  Rq(N)  is  the  sine  wave  response  due  to  the 
interaction  of  linear  motion  and  the  sensor  integration. 
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In  reference  (2) ,  it  was  shown  that  the  sine  wave  response  due  to  the 


interaction  of  linear  motion  and  sensor  integration  is  given  b}' 


R„(B) 


sin  (jtNv^  t^/2Y) 
jtNv^  t^/2Y 


(151) 


In  laboratory  measurements,  it  is  the  usual  practice  to  specify  the  bar 

pattern  velocity  in  terms  of  the  number  of  seconds,  t  ,  required  for  one  bar 

8 

in  the  teat  pattern  to  traverse  the  long  dimencion  of  the  field  of  view. 
Using  this  formulation,  pattern  velocity  is 


(152) 


(153) 


Eq.  (153)  is  plotted  in  Fig.  63  as  the  circled  points,  o,  and  the  measured 
static  square  wave  response  of  the  camera  and  lens  is  shown  by  the  open 
squares,  □  .  The  product  of  the  two,  Eq.  (150),  is  shown  by  the  solid 
circles,  •,  in  Fig.  64  and  ♦‘he  measured  dynamic  square  wave  response  is 
shown  by  the  solid  squares,  ■,  in  Fig.  64.  As  can  be  seen,  the  measured 
and  the  calculated  results  are  nearly  the  same.  For  a  given  spatial  frequency, 
the  measured  curve  is  about  .80  tines  the  calculated  curve.  It  is  believed 
that  this  discrepancy  is  due  to  the  lag  of  the  vidicon.  Lag  will  be 
discussed  further  in  the  next  section.  The  dynamic  square  wave  pattern 
response  of  Eq.  (150)  is  converted  to  a  dynamic  sine  wave  pattern  response, 

^oM’  (154),  successively,  starting  at  high  line  numbers  where 

is  nearly  zero  and  working  down  towards  lower  line  numbers. 
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Fig,  63  Relative  Reaponae  vs  Spatial  Frequency  for  Motion 
Experiment  □  Static  Case  with  Blower  on,  o  Pure 
Motion,  10  Sec/Picture  Height  for  a  Frame  Time  1/25  Sec. 


0  IOC  200  300  400  300  600  700  800 

Spatial  Frequency  (uines  per  pict  Kt) 

Fig.  64  Relati’i'e  Response  vs  Spatial  Frequency  -  Measured 

for  10  Sec/Picture  Height  •  .  Theoretical  • 
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(154) 


\m®>  '  I  -  i  f  i  .  .  .] 

In  conclusion,  it  is  seen  that  by  including  the  IfTF  for  sensor  exposure 

time  for  linear  motion  and  the  effects  of  1‘frF  of  the  sensor,  as  given  by 

{  and  k  in  the  SNR„  calculation  account  nearly  totally  for  motion 
^LT  ^LT 

effects  when  aperiodic  targets  are  used.  Further  confirmation  of  this 
should  be  obtained  using  other  speeds  but,  as  of  now,  the  conclusion  seems 
reasonable  and  will  be  used.  Of  course,  if  the  sensor  had  a  great  deal  of 
lag,  accounting  for  motion  by  the  above  method  is  inaccurate.  More  work 
remains  to  be  dona  in  this  area. 

4.2  Analysis  of  Sensor  Motion  Data 

It  was  seen  in  the  last  section  that  the  dynamic  square  wave  response 
of  the  laboratory  vidicon  which  was  used  for  the  psychophysical  experiments 
was  only  slightly  lower  than  that  predicted  by  the  product  of  the  vidicon' s 
Static  square  wave  response  and  the  MTF  that  is  characteristic  of  an 
ideal  integrating  surface.  It  is  of  Interest  to  Investigate  whether  such  a 
simple  result  car.  be  extended  to  ocher  camera  tubes  as  well.  In  the  following, 
experimental  results  confirm  that  this  model  can  be  used  for  resistive  sea 
silicon  diode  targeted  tubes  such  as  the  EBS  if  the  tube  is  operated  at  high 
target  voltages  (low  lag)  but  the  results  are  seen  to  be  extremely  optimistic 
if  the  target  is  operated  at  low  voltages  (high  lag). 

The  analysis  wliich  follows  is  an  extension  of  that  which  was  reported 
In  Ref.  (2).  The  measurements  were  made  on  a  Westinghu^se  WX-31841  camera 
tube  operated  at  high  (20  volts)  and  low  (7.5  volts)  target  voltages.  At 
the  high  target  voltage,  camera  lag  is  small  whereas  at  low  target  voltage. 
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camera  lag  is  high.  This  tube  employs  a  40  mm  diameter  photocatl.ode  of  the 
multialkali  type,  a  minifying  diode  electrostatic  image  section  and  a 
resistive  sea  type  silicon  diode  array  target  of  25  mm  active  diameter  with 
2,000  diodes  per  linear  inch.  The  readout  beam  is  magnetically  focussed  and 
deflected.  The  picture  aspect  ratio  was  4/3  (width-to-height) .  Measurements 
were  made  under  standard  TV  scan  conditions  utilizing  two  interlaced  fields 
per  frame.  The  preamplifier  noise  was  approximately  12  nA  (rms)  at  a  band¬ 
width  of  12  MHz.  Measurements  were  made  of  the  static  square  wave  response, 
of  dynamic  square  wave  response  using  a  moving  resolution  test  chart,  of 
buildup  and  decay  lag,  and  of  the  static  and  dynamic  liroitir.g  resolution. 

Dynamic  amplitude  response  measurements  were  obtained  by  imaging  a 
slant  burst  pattern  from  an  RCA  P-200  resolution  test  chart  onto  the  tube 
photocathode.  The  pattern  was  affixed  to  a  continuous  transparent  belt 
that  could  be  run  at  various  speeds  across  the  field  of  view  of  the  camera 
tube.  The  pattern  was  illuminated  from  behind  and  the  image  adjusted  to 
the  proper  size.  The  illumination  wus  adjusted  to  give  a  static  signal 
current  (in  excess  of  the  dark  current)  of  400nA.  The  signal  modulation  of 
the  line  bursts  was  displayed  on  an  oscilloscope  and  the  percent  modulation 
was  read  directly  from  the  oscillcscopi.  presentation.  With  this  chart,  a 
bandwidth  of  only  4  MHz  was  required  which  resulted  in  a  significant  decrease 
in  noise  and  allowed  the  direct  reading  of  the  oscilloscope  with  a  reasonable 
accuracy  for  chart  speeds  as  high  as  2.5  seconds  per  picture  width. 

Because  of  the  test  chart  design,  it  was  found  necessary  to  adjust  the 
chart  speed  for  each  resolution  line  number  in  order  to  obtain  an  equivalent 
single  speed  corresponding  to  that  which  would  have  been  used  with  a 
vertical  bar  chart.  Chart  speeds  were  employed  that  gave  equivalent  vertical 
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Fig,  55  Static  Amplitude  Response  for  WX31841 


bar  chart  speeds  of  60  sec/picture  width,  20  sec/picture  width  and  10  sec/ 
picture  width.  Measurements  ware  made  at  target  voltages  of  V,p  =  20  volts 
and  7.5  volts  for  resolution  line  bursts  of  100,  200,  400,  and  600  TVL  per 
Raster  Height. 

In  Fig.  65,  the  static  square  wave  response  is  shown  and  in  ’^igs.  68, 
67,  and  68,  the  dynamic  square  wave  response  are  shown.  Also  indicated  in 
the  figures  are  the  theoretical  curves  which  were  obtained  by  multiplication 
of  the  static  square  wave  respoi\se  aud  the  motion  MTF .  For  a  target  voltage 
of  =  20  volts,  the  low  lag  case  (3rd  field  signal  iswl97o),  the  measured 
data  and  calculated  data  are  similar  for  chart  speeds  of  10  and  20  seconds 
per  picture  width  (the  average  difference  is  24%),  and  for  60  seconds,  the 
measured  results  are  v.’ithin  an  average  of  8%  of  the  predicted  numbers.  With 
a  target  voltage  of  V,j,  =  7.5  volts,  the  high  lag  case  (3rd  field  current  is 


Fig.  66 


Dynamic  Amplitude  Response  for  Pattern  Speed  of  60  Second/ 
Picture  Width  Q  V„  =  20V,»V„  =  7.5V  for  WX  318a  -  Solid  ‘ 
Curve  Static  Case'^#  Theoretical 


Fig.  67  Dynamic  Amplitude  Response  for  Pattern  Speed  of  20  Seconds/ 
Picture  Width □  -  20V,«V„  =  7.5V  for  WX  3lSa  -  Solid 

Curve  Static  Case  •  Theoretical 
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w477o),  the  measured  result  Is  on  the  average  49%  smaller  than  the  calculated; 
the  difference  is  the  largest  for  the  fastest  target  speed. 

Plots  of  the  buildup  and  decay  values  are  shown  in  Fig.  69.  To  within 
the  experimental  accuracy  the  sum  of  the  two  values  at  a  given  target 
voltage  is  unity.  If  7  is  the  fraction  of  charge  neutralized  during  one 
readout,  then  as  is  shown  in  Ref.  (2),  che  buildup  lag  =  7  (5  -7)/4  and 
the  decay  lag  =  (4  •  7)(1  -  7)/4.  In  Fig.  70,  a  plot  of  7  is  shown  as  a 
function  of  target  voltuge  which  was  obtained  for  buildup  lag  using  the 
data  from  Ref.  (2).  From  Fig.  70,  it  is  seen  that  7  «  In  V.^,. 

For  the  above,  the  buildup  and  decay  lag  are  defined  as  follows.  A 
small  spot  of  light  is  imaged  onto  the  center  of  the  input  to  the  camera 
tube  and  the  resulting  signal  current  as  a  series  of  pulses,  one  for  each 
successive  field,  is  displayed  on  an  oscilloscope.  The  occurrence  of  a 
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Fig.  70  Gaitma,  7  for  Different  Target  Voltages  for  WX  31911 


134 


pulse  is  mid-time  between  the  beginning  and  end  of  any  field.  This  time 
is  given  a  field  designation.  At  the  same  time  during  a  vertical  flyback 
the  illumination  is  turned  on.  The  field  prior  to  this  is  designated  zero 
and  that  following  the  onset  of  illumination  is  denoted  one.  Thus,  the 
illumination  is  turned  on  mid-time  between  the  zero  and  first  field  readouts. 
The  light  remains  on  for  a  sufficient  number  of  fields  to  permit  a  steady 
state  to  occur  and  then  mid-time  between  two  successive  field  readouts  the 
illumination  is  removed  for  an  equal  number  of  fields.  The  build  up  lag  is 
defined  as  the  ratio  of  the  third  field  current  (after  turn  on  of  the  light) 
to  the  steady  state  value  times  100  and  the  decay  lap  is  defined  as  the 
ratio  of  the  third  field  current  (after  turn  off  of  the  light)  to  the 
steady  state  value  times  100. 

Similar  to  the  measurement  of  dynamic  amplitude  response,  measure¬ 
ments  were  made  of  the  tube  dynamic  limiting  resolution  by  imaging  a  1007. 
contrast  Westinghouse  vertical  bar  resolution  chart  on  the  earner.,  tube  and 
determining  the  minimum  illuminacion  required  to  permit  perception  of  various 
resolution  line  numbers.  For  these  tests  the  tvibe  was  operated  with  target 
voltages  of  7.5  and  20  volts  with  the  chart  stationary  and  moving  at  speeds 
of  60,  20,  10  and  5  seconds  per  picture  width.  411  measurements  were  made 
with  a  pbotocathode  potential  of  -lOKv  and  a  video  bandwidth  of  12  MHz. 

From  the  resulting  data,  curves  of  limiting  resolution  as  a  function  of 
photocathode  illumination  for  the  various  rates  of  image  motion  were 
generated.  These  are  presented  in  Fig.  71  for  a  target  voltage  of  20  volts 
and  Fig.  72  for  a  target  voltage  of  7.5  volts. 

Curves  similar  to  those  shovm  in  Figs.  71  and  72  were  generated  using 
357o  contrast  patterns  and  are  shown  in  Figs.  73  and  74.  One  image  speed 
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Fig.  71  Dynamic  Sensiti'd.ty  for  100?  Contrast  Pattern,  V,-  =  20  volts 
o  Static,  •  60  Sec/P.W.,  D  20  Sec/P.W.,  ■  10  Sec^^.W.,  0  5 
Sec/P.W. ,  Bandvddth  12MHz 


Fig.  72  Dynamic  Sensitivity  foi'  100^  Contrast  Pattern,  V„  =  7.5  volts 
ostatic,  •  60  Sec/P.W,,  □  20  Sec/P.W.,  ■  10  Sec^.W.,  O  5 
Sec/P.W.,  Bandwidth  12  MHz 
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Fig.  7'3  rhmamic  Sensitivi.ty  for  35/f  Contrast  Pattern,  V,p  ~  20  volts 
o  Static,  1  10  Sec/P.W.,  Bandwidth  12  Mz 
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Fig.  74  Djuandc  Sensitivity  for  35^  Contrast  Pattern  V„  =  7*5  volts 
o  Static,  ■  10  Sec/P.VI.,  Bandvddth  12  MHz 
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was  used,  10  seconds  per  picture  width  and  the  two  target  voltages  used  were 
20  and  7.5  volts.  For  each  target  voltage  with  the  35%  contrast  pattern, 
tha  loss  in  sensitivity  due  to  motion  is  approximately  the  same  as  that 
measured  for  the  same  speed  with  the  100%  contrast  pattern. 

Assume  that  the  threshold  SNRjj_.j,,  for  the  low  lag  situation  is  a 
constant,  independent  of  pattern  speed.  Then,  for  a  given  pattern  speed, 
the  increase  in  light  level  that  is  required  for  a  givsn  line  number  should 
be  inversely  proportional  to  the  dynamic  flux  factor.  Let  the  pattern 
speed  be  v  and  the  line  number  N.  Statically,  the  required  light  level  is 
Eg  and  dynamically,  the  required  light  level  is  E^,g.  If  the  static  flux 
factor  is  Rgp(N)  and  the  dynamic  flux  factor  R^gp(N)  then,  if  linear  motion 
alone  accounts  for  the  charge  in  light  level,  we  have  that 


(155) 


For  the  calculation  of  Rgp(N)  and  R^gp(N),  the  static  and  dynamic  sine  wave 
response  is  used,  respectively.  The  dynamic  sine  wa’'e  response  is  calculated 
from  the  dynamic  square  wave  response  as  discussed  above.  Our  assumption  of 
constant  SNRp_^,  independent  of  pattern  velocity  is  found  to  be  only 
approximately  true.  The  departures  are  the  largest  at  high  line  number 
and  high  pattern  speeds,  and  increases  in  Eg  of  a  factor  of  2  larger  than 
that  expected  by  Eq.  (155)  are  found.  The  results  are  further  off  fo’^  the 
high  lag  case,  an  added  increase  in  the  photocathode  illumination  from  2  to 
3  times  over  that  used  for  the  low  lag  case  were  found.  Thus  for  high  lag, 
discrepancies  (increases)  as  high  as  a  factor  of  5  or  more  greater  than 
that  expected  from  just  linear  motion  and  sensor  integration  are  required. 
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5.0  Psychophysical  Experiments  Involving  Sensor  MTF 

In  most  of  the  previous  psychophysical  experiments,  the  effects  of 
sensory  system  MTF's  were  avoided  by  using  electronically  generated  Imagery 
or  a  high  resolution  TV  camera  and,  test  images  whose  details  were  large 
enough  to  preclude  serious  image  smearing  effects.  In  Section  3,  we 
discussed  general  theories  concerning  the  effects  of  sensor  MTF's  on 
periodic  and  aperiodic  test  objects.  Whilt  the  theory  is  believed  to  be 
sound  and  has  been  shown  to  account  for  most  of  the  first  order  effects 
observed  experimentally,  specific  psychophysical  experiments  have  not  been 
performed  in  the  past  to  verify  the  theory  in  detail.  It  should  be  observed 
that  certain  of  the  effects  are  not  strong  variables  and  because  of  the 
statistical  nature  of  the  psychophysical  experiments,  difficulty  in  verifying 
the  theory  with  high  confidence  may  be  expected.  However,  thr  experiments 
performed  and  discussed  herein  do  tend  to  confirm  the  general  theory. 

The  experimental  set-up  of  Fig.  .5  was  used  to  perform  the  psychophysical 
experiments.  The  test  images  are  projected  on  the  faceplate  of  a  high 
resolution  1-1/2"  vidicon  operated  at  highlight  video  signal-to-noise  ratios 
of  50:1  or  better.  The  camera  and  TV  monitor  were  operated  at  25  frames/ 
second  with  875  scanning  liniS  (825  active).  Band-limited  white  noise  of 
Guassian  ditjtribu^ion  was  mixed  with  the  camera  generated  signals.  Both 
the  signals  and  noise  were  passed  through  identical  filters  (noise  equivalent 
bandwidth  of  12.5  MHz)  prior  to  mixing  in  the  monitor.  The  monitor 
luminance  was  approximately  1  ft.  Lambert  unless  otherwise  specified.  The 
displayed  picture  height  was  8"  and  the  observer-display  distance  was  28". 
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Pig.  75  Experimental  Set-up  for  the  Television  Camera  Generated 
Imagery 


The  ’.•TTF  of  the  set-up  (vidicon  and  lens)  was  changed  by  defocusing  the  lens. 

In  Fig,  76  the  overall  MTF's  that  corresponded  to  three  experimental 

conditions  are  shown.  For  Case  A,  the  lens  was  in  focus,  for  Case  B,  the 

lens  is  somewhat  out  of  focus,  and  for  Case  C,  the  lens  is  very  much  out  of 

focus.  The  values  of  N  ,,  and  N  fox  the  three  cases  are  listed  in  Table  8 

ex  eL 

where  N  and  N  are  calculated  from  Eqs.  (5  and  6).  N  is  the  overall 
CT  6L  6Li 

as  calculated  from  Fig.  76. 

Most  of  the  experiments  were  performed  using  the  MTF'  of  either  Casa 
A  or  Case  C.  The  method  of  limits  described  in  Ref.  (2)  was  used  to  take 
the  data.  The  camera  viewed  a  transparency  which  contained  a  number  of 
patterns  of  different  frequency.  The  video  signal-to-noise  ratios  were 
systematically  varied  in  1  db  steps  up  and  down,  and  at  each  step  the  subject 
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Fig. 76  Modulation  Transfer  Functions  for  Case  A  •  ,  Case  B  o  ,  and 
Case  CO-  Lens  and  Camera  Combined 


Case 

^eT 

N  T 
eL 

^eLT 

A 

2bl 

1266 

252 

B 

261 

123 

110 

C 

261 

72 

69 

Table  8  Value  of  N  „  and  N  _  and  Overall  N  for  Three  Cases 

eT  eL  eLT 
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Bar  Patterns  of  Variable  Aspect,  Isolated  Bars  and  Isolated 
Circles  Used  for  Experljnents 


was  required  to  specify  tl\e  highest  frequency  pattern  which  could  be  barely 
resolved.  Four  different  .Images  were  used,  isolated  circles,  isolated  bars, 
bar  patterns  of  variable  aspect,  and  bar  patterns  of  constant  aspect  (5:1). 
A  photograph  of  the  isolated  circles,  isolated  bars  and  bar  patterns  of 
variable  aspect  is  shown  in  F.ig.  77  and  in  Fig,  78  a  photograph  of  the 
constant  aspe^-t  bar  patterns  is  shown.  Table  9  lists  the  line  number,  N, 
for  the  various  images  calculated  from 


N  = 


(156) 


where  H  is  the  effective  height  of  the  transparency  (that  which  is  projected 
onto  the  photocathode  of  height  .6  =  Y  where  1)^^  is  the  photocathode 

diameter)  and  is  the  width  of  a  bar,  Ax  is  the  bar  width  on  the  photo¬ 
cathode.  Also  listed  in  Table  9  is  '.he  bar  length/width  ratio,  n^.  For 
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Fig.  78  Bar  Patterns  of  Constant  Aspect  Used  for  Experiments 


the  isolated  circles,  an  equivalent  square  is  assumed,  one  whose  area  is 


the  same  as  that  of  the  circle,  e.g. 


(157) 


where  D  is  the  diameter  of  the  circle. 

For  bar  patterns,  is  calculated  on  the  basis  of  the  total  area 

of  a  bar.  Specifically,  the  equation 


SNR 


DI 


2t  n  Af,, 
V  V 

a 


1 


hr 


(t)’ 


(158) 


is  used.  In  the  above,  Ai  is  the  peak-to-peak  signal  current  for  a  broad 
area  pattern  (unity  modulation  transfer  function)  and  is  the  rms  noise 
that  is  added  to  the  camera  generated  image.  Real  cameras,  of  course. 
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Pattern 


Isolated 

Circles 

Isolated 

Bars 

Variable  Aspect 
Bar  Patterns 

— 

Constant  Aspect 
Bar  Patterns 

N 

n 

V 

N 

N 

N 

n 

V 

37 

1 

74 

5.3 

74 

5.3 

104 

5 

71 

1 

261 

19.0 

261 

19.0 

200 

5 

121 

1 

357 

25.8 

357 

25.8 

329 

5 

184 

1 

494 

35.6 

494 

35.6 

396 

5 

300 

1 

625 

45.1 

625 

45-1 

48f; 

5 

31U 

1 

760 

54.8 

760 

54.8 

635 

5 

866 

1 

900 

65.0 

900 

65.0 

729 

5 

1090 

78.6 

1090 

78.6 

800 

5 

1205 

88.6 

3205 

88.6 

1605 

116.0 

1605 

U6.0 

1780 

125.0 

1780 

325.0 

Tabic  9  Line  Niunber  and  Bar  Aspect  fcr  Various  Patterns 
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have  a  response  that  is  a  function  of  frequency  and  the  value  of  Zli  in 
the  video  channel  for  square  wave  inputs  becomes  Aip_p,  the  peak-to-peak 
value  of  the  video  signal  when  the  frequency  effects  are  included.  That 
is, 


(159) 


-  •J 


or.(N)  Ai 

SF  p-p 


(160) 


where  R__(N)  is  the  value  of  the  flux  factor  at  N,  Rca(N)  is  the  value  of 

or  ovj 

the  square  wave  response  ac  N  and  Aip_p  the  value  of  the  peak-to-peak 
signal  corresponding  to  N  as  measured  in  the  output  of  the  video  channel. 
Alternately,  one  could  measure  Ai  for  a  broad  area  pattern  and  use  Eq.  (158), 


In  any  event,  is  given  by 


where 


("vIl)  " 

”el  ■  ® 


(161) 


(162) 


"eT  ■  IKM' 


(163) 


For  calculation  purposes,  t,  the  integration  time  of  the  eye  is  taken  to 
be  0.1  sec  and  a  ,  the  picture  aspect  ratio  is  4/3.  At  low  spatial 
frequencies  the  displayed  Images  approach  a  squaie  wave  while  at  high 
spatial  frequencies,  above  about  300  lines/picture  height  for  Case  A  the 


145 


displayed  images  were  nearly  pure  sine  waves. 

For  the  isolated  bars  and  circles,  the  aperiodic  object  form  of  the 
signal-to-noise  ratio  should  be  used  for  calculating  and  it  is 

repeated  here  as 


(164) 


(165) 


For  the  first  experiment  (called  experiment  #1),  the  constant  aspect 

bar  patterns  were  used.  The  experimental  conditions  were  the  same  as  those 
used  previously  (10  months  earlier)  which  were  reported  in  AFAL-TR-72-229 

and  the  purpose  of  the  present  experiment  was  to  establish  a  "bench  mark" 
between  the  previous  and  the  new  results.  Experimental  conditions  are 
listed  in  Table  in  Five  subjects  participated.  In  Fig,  79,  the  data  from 
the  present  experiment  is  shown  by  the  open  circle  points,  o,  and  the 
original  data  by  the  solid  circle  points,  •.  A  comparison  of  the  two  shows 
that  there  is  nearly  a  constant  percentage  reduction  in  the  threshold 
at  a  given  line  number  for  the  new  data.  This  difference  was  quite 
unexpected,  in  the  original  and  the  present  experiment,  the  brightness  of 
the  room  surrounding  the  monitor  was  approximately  the  same,  .05  ft. Lambert. 

The  experiment  was  repeated  with  the  same  subjects  with  the  room 
brightness  surrounding  the  monitor  equal  to  1  ft.  Lambert  and  the  data  is 
plotted  in  Fig.  80  with  the  threshold  SNR^j.  values  plotted  in  Fig,  79  by 


146 


Exp. 

No. 

Test  Images 

(1) 

^0 

(2) 

s 

(3) 

MTF 

Shape 

(4) 

No. 

Obs. 

(5) 

of 

Trials 

(6) 

No.  of 
Scan 
Lines 

(7) 

Frames/ 

Second 

Figure 

No. 

1 

Constant  Aspect 

1 

0.05 

A 

■ 

210 

875 

25 

79 

2 

Constant  Aspect 

1 

1 

A 

5 

1230 

875 

25 

80,88 

3 

Constant  Aspect- 
Critical 

1 

1 

A 

1 

217 

875 

25 

1 

81 

4 

Electronic  Squares 

1 

0.05 

A 

4 

720 

525 

30 

82,83 

5 

Constant  Aspect 

1 

1 

B 

5 

1080 

875 

25 

84,85 

88 

6 

Constant  Aspect 

1 

1 

C 

5 

953 

875 

25 

86,87 

88 

7 

Constant  Length 

1 

1 

A 

6 

1730 

875 

25 

89, 9i 

8 

Constant  Length 

1 

1 

C 

5 

1400 

875 

25 

91 

9 

Isolated  Bars 

1 

1 

A 

6 

1730 

i  875 

25 

92 

10 

Isolated  Bars 

1 

1 

C 

5 

1400 

875 

25 

92 

11 

Isolated  Circles 

D 

1 

A 

6 

1730 

875 

25 

93 

12 

Isolated  Circles 

B 

1 

C 

5 

1400 

875 

25 

93 

13 

Tactical  Targets 

1 

1 

A 

5 

1000 

875 

25 

93,94 

95 

14 

Tactical  Targets 

1 

1 

C 

5 

1000 

875 

25 

93 

15 

Tactical  10  Sec/PW 

1 

1 

1 

D 

3 

600 

875 

25 

-- 

Table  10  Experimental  Conditions 


NOTES: 

(1)  Average  Monitor  Luminance,  ft-L 

(2)  Average  Background  Luminance,  ft-L 

(3)  MTF  Case  A,  B,  or  C  Used 

(4)  Total  Number  cf  Observers 

(5)  Total  Number  of  Trials 

(6)  Number  of  Scan  Lines  per  Picture  Height,  Interlaced 

(7)  Number  of  Frames  per  Second  Noise  Bandwidth  12.5  MHz, 
Viewing  Distance  28  inches,  8-inch  High  Monitor 
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Fig.  79  Escp.  No.  1  and  2,  Threshold  SNRpj  for  •  Original  Data  and 

Present  Bata  o  Minintum  Illundnation  Background  □  1  ft-Lambert 
Background  --  Const, ant  Aspect  Pattern  Case  A  MTF 


Pi  splay  Signal-to-Noise  Ratio 


Fig. 80  Exp.  No.  2  Probability  of  Bar  Pattern  Recognition 

Versus  Display  Signal  to  Noise  Ratio  for  Case  A  NTF, 
1  ft-lAmbert  Monitor  and  1  ft-Lambert  Background  Bar 
Pattern  Spatial  Frequency  o  104,  •  2C0,  0  329,  S  396, 
O  482,  ♦  635  AF  5  Bar 
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Fig.  81  Exp.  No.  3-  Threshold  SNRqt  for  •  Original  Data  and 
Present  Data  1  ft. -Lambert  Background  O  Nonnal  □  Very 
Critical  Threshold  Judgment  -  Constant  Aspect  Pattern 
Case  A  MTF 


the  square  data  points,  o  .  As  can  be  seen  from  a  comparison  of  the 
squares  and  open  circle  of  Fig.  79,  the  effect  of  the  surrounding  bright¬ 
ness  was  negligible  but,  again  lower  threshold  values  of  SNR^j  were 
obtained  than  were  obtained  on  the  previous  program. 

After  carefully  checking  the  experimental  set-up,  recalibrating  meters 
and  oscilloscopes,  checking  terminations,  lens  focus,  camera  MTF,  and 
signal  currents,  a  third  experiment  was  performed  with  one  observer  in 
which  an  attempt  was  made  to  be  much  more  critical  in  establishing  the 
criteria  for  resolving  or  not  resolving  of  the  bar  pattern.  The  background 
was  at  1  ft.  Lambert.  The  threshold  SNR^  results  are  shown  in  Fig.  81  by 
the  square  data  points  and  then  for  experiment  #1,  by  the  open  circles  and, 
again  tor  comparison,  the  original  data  from  Ref.  (  2 )  is  shown  by  solid 
circles.  It  was  hypothesized  that  a  more  critical  criteria  for  bar  pattern 
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Fig.  82  The  Display  Signal-to4Ioise  Ttatio  Experiment 

recognition  would  correspond  with  increased  SNR^j  values  and  indeed,  as  is 
seen  in  Fig.  81  at  low  line  numbers,  this  hypothesis  is  born  out.  However, 
virtually  no  change  is  observed  at  higher  line  numbers.  A  conscious  change 
in  the  threshold  does  not  account  for  the  change  in  the  experimental  results. 
Why  then  are  the  present  results  different? 

For  both  of  the  present  experiments  and  the  previous  ones  a  more  or 
less  constant  pool  of  about  10  people  were  used.  All  of  these  people  were 
involved  in  numerous  other  resolution  experiments  between  the  old  program 
and  the  .lew  and  it  is  postulated  that,  the  difference  in  the  curves  reflect 
the  learning  curves  of  the  subjects.  Time  did  not  permit  rerunning  of  the 
experiments  with  untrained  subjects. 

As  a  final  check  of  the  calibration  of  .""Ur  equipment,  an  experiment 
was  run  using  the  set-up  shov'r.  in  Fig.  82.  xhe  set-up  involved  replacing 
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Fig.  83  Eaqp.  No.  4-  Threshold  SNRq];  for  Electronically  Generated 
Squares  o  New  Fata  □  Old  Data 


the  vidicon  by  the  electronic  pulse  generator  and  operating  the  monitor 
at  the  lower  scan  rate.  The  subject  had  to  say  in  which  quadrant  of  the 
display  the  electronically  generated  square  was.  Position,  size,  and  SNR^ 
were  randomly  varied.  In  Fig.  83,  the  threshold  values  of  as  a 

function  of  square  width  (expressed  in  number  of  raster  scan  lines  for 
convenience),  is  shown  for  the  present  experiment  by  the  open  circle  points, 
o,  and  the  results  from  the  previous  experiment  j^Ref.  (2  >3,  performed  a 
year  earlier  by  the  open  squares,  a  .  No  difference  between  the  two 
results  can  be  seen  and  it  is  concluded  that  the  experimental  set-up  is 
correctly  calibrated  and  that,  most  likely,  the  differences  which  were 
observed  for  the  bar  patterns  recognition  experiments  were  due  to  observer 
training. 

Part  of  the  problem  with  the  bar  pattern  experiments  is  that  there 
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o  way  to  judge  the  correctness  of  the  observer's  response.  An 
erver  said  he  could  resolve  a  given  pattern  but  this  is  highly  subjective, 
and,  appar.  ntly  the  criterion  (be  it  uncomcious)  changed  with  training. 

For  the  detcvtion  of  squares,  we  know  if  the  subject  was  right  or  not  and, 
indeed  we  can  correct  for  randou  guesses.  Bar  pattern  recognition  could  be 
made  less  subjective  if  an  elrment  of  correctness/wrongness  was  InLroducec' 
ouch  as  having  a  break  in  a  bar  and  asking  where  the  break  was  or  maybe 
using  different  size  Landalt  C's  with  the  position  of  the  break  randomly 
varied  and  again  asking  where  the  break  was.  Time  did  not  permit  testing 
of  either  of  these  hypotheses.  A  comparison  of  the  new  data  discussed 
above  and  that  which  will  be  discussed  below  does  show  that  a  high  degree 
of  consistency  exists  for  similar  experiments  and  we  believe  that  valid 
conclusions  can  be  drawn  from  these  experiments. 

For  the  fifth  experiment,  set-up  B  for  the  MTF  was  used.  Again  the 
constant  aspect  pattern  was  utilized  and  Jn  Fig.  84,  the  probability  versus 
SNR^j  is  plotted  as  a  function  of  different  spatial  frequencies.  In  Fig.  85, 
the  threshold  '’^DI  plotted  versus  spatial  frequency.  A 

comparison  of  Figs.  80  and  85  shows  that  nearly  the  same  SNRj^j  values  are 
obtained  for  the  two  MTF  cases  with  slightly  closer  agreement  being  obtained 
at  the  lower  frequencies  than  at  the  higher  frequencies.  Finally,  experiment 
six  was  performed  with  case  C's  MTF  and  the  constant  aspect  pattern. 
Probability  versus  for  this  case  is  plotted  in  Fig.  86  and  threshold 

SNRjjj  versus  spatial  frequency  is  plotted  in  Fig.  37.  Comparing  Figs.  80 
and  87,  we  see  that  again  for  low  frequencies,  the  results  are  nearly  the 
same  for  Case  A  and  Caje  C  MTF's  but  for  higher  frequencies,  lower  values 
cf  threshold  SNR^j.  is  obtained  for  Case  C  then  for  Case  A.  The  above 
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»  Probability  of  Bar  Pattern 

Threshold  Recognition 


Fig.  86  Exp.  ’lo.  6.  Probability  of  Bar  Pattern  Recognition  for 
Case  C,  Constant  Aspeit  Bar  Patterns  Spatial  Frequency  o 

104,*  200,  □  329 
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Fig.  87  Exp.  No.  6.  Threshold  SNRdj  for  Case  C, 
Constant  Aspect  Pattern 
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Fig.  88 


Threshold  SNRpj  for  AF  5  Bar  Pattern  Case  A  • 
Case  B  o  ,  Case  C  □  MTF's 


results  are  sununarized  in  Fig.  88  for  the  constant  aspect  patterns  for 
Case  A,  B,  and  C  MTF's.  The  values  of  are  somewhat  lower  for  Case  B 

and  C  than  A  for  higher  spatial  frequencies.  One  must  be  careful  in 
concluding  that  lower  SNRjjj,  values  are  obtained  with  poor  MTF.  Comparing 
the  spread  in  the  data  at  low  frequencies  where  the  experimental  accuracy 
is  the  best  shows  a  fairly  large  spread  in  the  data  so  the  difference  is 
probably  not  very  significant. 

It  must  be  also  kept  in  mind  that  the  calculation  of  SNR^  includes  the 
MTF's  effect  on  signal  and  on  noise.  For  a  given  line  number  and  SNRj^  value, 
a  much  higher  video  signal-to-uoise  ratio  is  required  for  Case  C  MTF  than 
for  Case  A  MTF.  The  experimentally  determined  threshold  values  of  SNRj^  are 
somewiiat  lower  for  Case  C's  MTF  than  those  for  Case  A's  and  as  was  mentioned 
the  differences  may  be  reflecting  experimental  error.  More  likely,  we  believe. 


155 


Display  Slgnal-to-Noise  Ratio _ _ _ 

Fig.  89  Probability  of  Bar  Pattern  Recognition  for 
Constant  Length  Bar  Patterns  -  Case  A  MTP 

is  that  for  poor  MTF's,  our  formulation  for  SNRj^  is  rather  pessimistic, 
that  is,  the  MTF's  do  not  degrade  the  images  detectability  as  much  as 
theory  would  indicate.  In  any  event,  for  the  same  broad  area  video  signal- 
to-noise  ratio,  the  better  the  MTF  is,  the  more  detectable  the  image  is. 

Experiment  7  used  Case  A  MTF  with  the  bar  patterns  of  variable  aspect 
and  the  experimental  results  are  shown  in  Figs.  89  and  90.  For  comparison, 
the  results  with  the  constant  aspect  patterns  are  also  shown  in  Fig.  90 
and  as  is  seen,  the  two  cases  are  very  similar  for  all  but  the  highest  line 
numbers. 

Experiment  8  utilized  the  variable  aspect  pattern  with  Case  C  MTF  and 
the  threshold  SNR^  vs  spatial  frequency  curves  for  Case  A  and  C  are  plotted 
in  Fig.  91  .  A  somewhat  lower  result  was  obtained  for  Case  C  than  for  Case 

A. 
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Fig.  90  Exp.  No.  7.  Comp&rision  of  Threshold  SNRj,j  for  Case  A 
MTF,  •  Constant  Length,  •  Constant  Aspect  rar  Patterns 
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Fig.  92.  Exp.  No.  9  and  10,  Tnreshold  SNRpj  for  Isolated  Bars  for 

Case  A  o  ,  Case  C  O  MTF'SjO  Electronically  Generated  Squares 


The  pattern  with  the  isolated  bars  was  used  for  the  next  two  experiments, 
Case  A  MTF  in  experiment  9  and  Case  C  MTF  in  experiment  10.  The  threshold 
SNRpj  versus  spatial  frequency  plots  for  the  two  cases  is  shown  in  Fig.  92. 

The  data  is  tually  the  same  up  to  a  spatial  frequency  of  about  500  lines/ 
picture  height  ^nd  then  the  data  for  Case  C  rises  at  a  nearly  constant  rate. 

A  rise  in  the  threshold  curve  for  Case  A  MTF  is  suggested  at  very  high  line 
numbers,  N  =  1780.  A  comparison  of  the  data  from  Fig. 83  for  the 
electronically  generated  squares  and  that  for  isolated  bars  of  Fig.  92 
shows  that  the  two  sets  of  data  are  similar  at  low  line  numbers,  the  Case  A 
MTF  data  being  nearly  the  same  as  that  for  the  electronic  generated  squares. 
This  of  course  is  not  a  surprise.  At  low  line  number  for  Case  A,  aperture 
effects  are  minimized  and  the  results  should  be  similar  to  those  measured 
for  the  electronically  generated  squarts  where  aperture  effects  are 
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0  100  200  500  400  500  600  700 
Equivalent  Spatial  Frequency  (Lines/Picture  Height) 

Fig.  93  Exp.  No.  11  and  12.  Threshold  SNRpj  for  Isolated  Circles 

for  Case  A  o  ,  Case  C  □  MTF's,0  Electronically  Generated  Squares 

negligible.  This  is  further  evidence  tu?t  the  present  experimental  set-up 
is  functioning  correctly. 

The  pattern  with  the  isolated  circles  was  also  used  with  Case  A  MTF 
and  Case  C  MTF  and  the  threshold  is  plotted  versus  spatial  frequency 

for  the  two  cases  in  Fig.  93.  Again,  it  is  found  that  the  data  is  con¬ 
sistent  with  that  measured  with  the  aperture  free,  electronic-target 
generator. 

For  aperiodic  targets,  frem  the  comparison  of  the  experiments  with 
isolated  bars  and  circles  and  those  of  the  aperture  free  squares,  it  is 
seen  that  the  theory  as  given  by  Eqs.  (164)  and  (165)  is  confirmed,  within 
experimental  accuracy,  for  MTF's  that  are  quite  different  from  one  another 
(N^  =  252  for  Case  A  and  =  69  for  Case  C).  Furthermore,  it  is  seen  that 
for  bar  patterns,  the  theory  as  given  by  Eqs.  (160),  (161),  (162),  and  (163), 


Fig.  94  Photographs  of  Models  Used  for  Recognition  Experiments  -  Upper  Left., 
T-ankj  Upper  Right,  Van  Truck;  Lower  Left,  Half  Track  with  Antenna; 
and  Lower  Right,  Derrick  Half  Track. 

gives  a  somewhat  pessimistic  result  (smaller  SNRjj^)  for  poor  MTF's  than  it 
does  for  good  MTF's.  In  effect,  a  system  of  poor  MTF  would  actually  perform 
somewhat  better  than  the  theory  would  suggest.  The  differences  are  in 
such  a  direction  as  to  help  the  system  designer. 

Using  the  experimental  set-up  of  fig.  i,  experiraeuLa  were  performed  on 
tactical  target  recognitions  using  Case  A  and  Case  C  to  establish  the  impact 
of  MTF's  on  real  target  recognition.  The  transparencies  whirh  were  used 
were  made  from  high  quality  photographs  of  vehicles  amid  a  uniform  white 
background.  The  photographs  were  taken  at  a  depression  angle  of  45®  from 
the  horizontal  and  perpendicular  to  the  vehicle's  longitudinal  axis,  i.e., 
the  sides  and  tops  of  the  vehicles  were  imaged  as  is  shown  in  Fig.  94. 

The  vehicles  included  a  tank,  a  van  truck,  a  half  track  with  top-mounted 
radar  antenna  and  a  tracked  bulldozer  with  derrick.  The  areas  of  the 
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various  vehicles  were  approximately  0.057  in^  on  the  8"  x  10.7"  display 
and  subtended  angles  of  about  0.34°  by  0.68°  ac  the  observer's  eye.  The. 
vehicle  types  and  video  SNR  were  randomly  varied;  and  the  probabilities 
of  recognition,  corrected  for  change,  were  determined.  The  SNE^^'s  for 
the  various  images  were  calculated  on  the  basis  of  the  area  of  a  bar 
whose  length  and  width  are  equal  to  the  length  of  the  vehicle's  image  and 
the  width  of  the  vehicle's  image  divided  by  8.  This  is  in  accord  with  the 
equivalent  bar  pattern  concept  discussed  in  AFAL-TR-72-229,  We  note, 
however,  one  difference  between  the  calculations  for  the  bar  pattern  and 
the  vehicular  image's  In  the  case  of  the  vehicular  image,  the 

signal  amplitude  was  measured  from  the  background  signal  level  which  was 
approximately  constant,  to  the  peak  object  signal  level.  For  the  "equivalent 
bar  patterns,"  the  signal  levels  were  measured  in  terms  of  the  mean  signal 

excursion  within  the  bar  pattern  area  in  the  periodic  direction.  Had  the 
peak-to-peak  excursions  about  the  average  signal  within  the  vehicle  area 
been  used  (when  the  object  is  imaged  against  a  uniform  background),  the 
thresholds  SNR^j  would  have  been  somewhat  lower. 

These  difficulties  result  from  the  necessity  of  defining  an  image  area 
and  a  signal  excursion  in  order  to  calculate  an  SNR^j  threshold.  In  this 
connection,  we  observe  that  tne  criterion  for  bar  pattern  recognition  is 
that  the  observer  must  be  able  to  discern  a  modulation  within  the  bar 
pattern  whereas  for  vehicle  image  recognition,  the  vehicle's  outline  must  be 
discerned.  This  outline  may  have  periodic  features  but  is  more  likely  to 
be  aperiodic. 

Specifically,  the  SNR^j  was  calculated  from 
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Fig.  95  Exp.  No.  2,3*  Tactical  Targeb  Rscogniticr  for  Case  A  MTF 
o  Tank,  •  Derrick,  □  Truck,  O  Radar  Tinick 


Vfhere  SNR^  was  the  largest  zero  to  peak  voltage  in  a  frame  of  the  image 
divided  by  the  RMS  value  of  the  noise.  The  value  of  a/A  that  was  used  was 
the  actual  area  of  the  image,  a,  on  the  transparency  divided  by  the  total 
area  of  the  transparency,  A,  that  was  viewed.  The  factor  of  8  in  Eq.  (166), 
comes  from  the  assumption  that  we  are  to  calculate  on  an  equivalent 

bar  pattern  basis,  that  is,  for  recognition,  one  whose  bars  are  each  a/8 
in  area.  In  Figs,  95  and  96  ,  the  probability  versus  is  plotted 

for  tactical  target  recognition  for*  Case  A  and  Case  C,  respectively.  For 
Case  A,  the  average  threshold  is  3.2  where  as  for  Case  C,  ihe 

average  threshold  SNRp^  is  4,?  ;  a  value  that  is  347.  higher  than  that  for 
Case  A. 
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Fig.  96  Ebqj.  No.  14.  Tactical  Target  Recognition  for  Case  C  MTF 
o  Tank,  •  Derrick,  □  Truck,  O  Radar  Truck 


In  Fig.  97  ,  we  show  the  signal  excursions  for  the  tracked  bulldozer 
on  selected  horizontel  lines  from  the  top  to  the  bottom  of  the  vehicle  with 
li.ne  1  being  just  above  the  object  and  lins  17  just  below.  The  MTF  which 
was  used  was  Case  A.  These  traces  were  taken  on  every  other  line  from  a 
line  selector  oscilloscope.  The  dominant  features  of  the  bulldozer  shown 
pictorially  in  Fig.  94  can  be  located  iu  the  traces  of  Fig.  97  .  The 
boom  arm  is  in  traces  3  through  6,  the  cab  in  6  through  8  and  the  bulldozer 
blade  in  9  through  13,  The  boom  appeared  to  be  the  most  characteristic 
feature  and  the  width  was  of  the  order  of  1/8  width  of  the  bulldozer. 

Strictly  opeaking,  the  tactical  targets  are  not  either  periodic  or 
aperiodic  in  structure.  However,  as  is  discussed  in  the  section  on  motion^ 
if  the  aperiodic  form  of  the  equation  is  used  together  with  the 

assumption  that  the  original  dimension,  x^,  y^  can  be  associated  with  an 

i 

i 
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Fig.  97  Waveform  of  Derrick  Half  Track  Along  the  Hori7,ontal  ao  a  Function 
of  Vertical  Position  of  Scan  Lines. 


equivalent  bar  pattern  (o.g.  with  bars  long  and  x^/8  wide  for  recogni¬ 
tion)  then  the  static  and  motion  results  can  be  accounted  for  by  the  same 
threshold  SWR^^  value.  Furthermore,  as  we  will  no f  show,  the  same  value 
SNRjj  also  holds  for  widely  different  MTF  characteristics  as  well. 

The  value  of  aperiodic  SNRpj  is  calculated  from 


bNR, 


DI 


where 


«y 

LT  ^LT 


SNRy 


LT  ^LT 


1  f 


(167) 
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and 
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Using  Eqs.  (167),  (168),  (169),  and  (170),  we  have  that  for  Case  A 
SNRpj  =2.2  whereas  for  Case  C,  =  1.7  and  the  two  values  of  SNRpj 

are  somewhat  closer  in  magnitude  than  those  obtained  ignoring  MTF  effects. 
The  fact  that  the  SNRjjj  for  poor  MTF's  is  smaller  may  indicate  that  the 
effects  of  the  poor  MTF's  are  not  quite  as  bad  as  the  SNRj^  equations  would 
suggest.  A  similar  result  was  obtained  for  bar  patterns  and  we  tentatively 
conclude  that  our  theory  is  too  pessimistic  for  very  poor  MTF's.  Much 
more  experimental  data  aeeds  to  be  taken  for  different  MTF  cases  to 
establish  the  limits  of  our  theories. 
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6.0  L^-asures  of  Image  (Quality 

There  has  been  considerable  interest  by  researchers  in  the 
optical  and  electro-optical  field  in  finding  a  single  measure  of  dmage 
quality.  Such  a  number  might  be  useful  in  conqjarlng  and  specifying 
electro-optical  conqjonents  and  may  aTso  be  used  in  the  design  of  the  comr- 
ponents.  A  specific  design  example  is  the  shape  of  an  MTF  cui*ve.  In 
many  r-ses,  an  MTF  can  be  optimized  for  either  a  maximum  7-ow  frequency 
response  such  as  curve  A  of  Fig,  98*  or  for  a  maximum  high  frequency 
response  at  the  expense  of  the  low  freqi  •  ncy  response  as  shown  by 
curve  B  of  the  same  figxire,  V7ith  the  curve  k,  aperiodic  signal  levels  will 
be  generally  higher  ■^han  with  curve  B  while  with  curve  B,  high  frequency 
periodic  patterns  can  be  discerned  that  cannot  be  seen  at  all  with  an  MTF 
corresponding  to  curve  A. 

To  resolve  fine  image  details,  a  sensor's  MTF,  pro,iected  into 
object  space  must  be  sufficiently  high  relative  to  the  scene  objects 
of  interest.  While  a  high  MTF  is  a  necessary  condition,  it  is  not 
sufficient .  A  fine  grain  photographic  film  may  produce  very  high  resolution 
of  a  day-lighted  scene  but  be  next  to  useless  in  a  dimly  lit  cathedral. 

For  the  Indoor  scene,  the  photographer  may  need  to  select  a  coarser  grain 
film  of  higher  sensitivity,  bimilarly,  a  high  resolution  vidicon  cannot 
compete  with  a  moderately  low  resolution,  low  light  level  television  at 
night  buc  on  the  other  hand,  the  high  resolution  vidicon  camera  will 
far  outclass  the  LLLTV  by  day.  It  i  thus  readily  evident  that  picture 
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Fi^.  98  Two  Modulation  Transfer  Functions.  Curve  A  Illustrates  a  High, 
Low  Frequency  Response  While  Curve  B  Illustrates  a  Hj.gh,  High 
Frequency  Response. 

quality  is  a  function  of  both  resolution  lijriting  parameters  such  as 
the  sensor  MTF's  aixd  the  sensor  sensitivity.  The  picture  qualily 
can  also  be  a  function  of  the  sensor's  dynamic  range  and  the  scene 
itself. 

To  begin  this  discussion,  we  will  first  discuss  the  MTF  related 
parameters  and  their  effect  on  i  •  quality.  These  factors  have  been 
the  object  of  the  most  concern  from  a  historical  point  of  view. 

6.1  MTF  Related  Image  Quality  Parameters 

In  1881,  Lord  Rayleigh  proposed  a  resolution  measure  for 
optical  devicpo  using  two  .oint  source  images.  As  discussed  in  Section 
2,  a  Ions  images  a  point  as  a  blur.  As  two  point  images  are  brought 
closer  together,  a  point  vrDl  be  reached  where  they  are  no  longer  resolved 
as  two  points,  but  as  one.  Lord  Rayleigh's  criterion,  however,  demands 
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that  the  two  images  be  resolved  and  the  criteria  was  set  so  that  the 
minimum  signal  excursion  between  the  peaks  of  the  two  points  and  the 
valley  between  be  19^  or  more.  This  criterion  is  Judged  by  many  to  be 
too  severe,  e.g.,  that  the  points  can  be  resolved  as  two  with  a  much 
smaller  signal  excursion.  However,  as  we  have  nated  above  other 
factors  must  be  considered.  With  test  point  images  of  low  intensity, 
a  19%  signal  excursion  may  nob  be  enough. 

The  modulation  transfer  curves  such  as  those  shown  in  Fig.  9^ 
have  been  ;ised  in  a  similar  manner.  The  "limit  of  resolution"  has 
often  been  taken  to  be  that  spatial  frequency  at  which  the  MTF  has  fallen 
to  some  low  value  such  as  5%  or  2^.  The  2%  figu-^e  is  especially  popular 
since  it  is  often  assumed  that  the  eye  cannot  detect  image  contrasts 
below  about  2%.  However,  image  contrasts  lower  than  2%  can  be 
discerned  by  the  unaided  eye  under  many  conditions.  Also  in  many 
electro-optical  iensors,  the  displayed  contrast  may  be  many  times  higher 
than  the  scene  contrs.ot.  This  is  particularly  true  for  FUR  equipments 
in  the  8  -  13  band.  With  inherent  scene  contrasts  ;>f  only  a  few 
percent,  the  displayed  image  contrast  will  usually  be  near  10J;«. 

Thus  the  eye's  2%  "contrast  limit"  has  little  merit  as  a  criterion  when 
the  displayed  irasge  contrast  is  variable. 

However,  the  modulatlcii  trax.sfsr  functicsn  has  a  strong  effect 
on  picture  quality  As  we  have  shown  in  Sections  2  suid  3j  the  modu¬ 
lation  transfer  function  can  both  decrease  perceived  signal  and  increase 
perceived  noise  It  also  limits  the  size  of  the  small*  scene  detail 
that  can  be  seen.  We  note  again  before  proceeding,  that  the  smallest 
detail  that  can  be  seen  is  not  anly  a  function  of  the  HTF  but  also  of 
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the  signal  and  noise  levels  and  therefore  a  good  sensor  MTF  alone 

does  not  guarantee  high  resolution.  On  the  other  hand,  a  high  resolution 

of  scene  detail  will  not  be  obtained  vdthout  a  high  MTF. 

An  MTF  is  synonymous  with  the  frequency  response  of  an  electrical 
filter.  As  is  well  known,  a  wide  freqi^ency  response  is  need  to  transmit 
short  pulses  and  similarly  a  wide  MTF  is  need  to  transmit  point  or  line 
images.  Electrical  engineers  are  fond  of  the  concept  of  equivalent 
bandwidth  which  is  defined  as  the  width  of  a  rectangle  whose  area  is  the 
same  as  the  area  under  the  MTF  curve.  Since  the  value  of  the  MTF  at 
zero  frequency  is  unity,  the  width  of  the  rectangle  (or  equivalent 
bandwidth)  is  equal  to 

Nb  =  j”  i  •  (Wl) 

Corresponding  to  N^,  there  will  be  an  equivalent  impulse  response 
width,  where 

6(3  iT  •  (^'72) 

ni 

As  is  evident,  the  larger  the  bandwidth  Nj^,  the  smaller  will 
be  the  equivalent  impulse  response  width.  Since  the  displayed  itaage's 
detail  is  the  convolution  of  the  input  image  with  the  sensor's  impulse 
response,  a  wide  impulse  response  width  will  result  in  a  loss  of  image 
detail. 

The  Eq.  (I71)  can  be  written  in  two-dimensional  form  as 


=  4"  4“ 


E  (N  N  )l  dH  dN 

o'-  X  y^'  X  y 


(173) 


This  equation  has  been  related  directly  to  the  Strehl  measure  of  image 
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99  MTF,  Equivalent  Bandwidth  N.  and  Noise  Eqiii valent  Bandwidth  vs 
Spatial  Frequency  for  a  Typical  40/40/25  I-EBSICON  Camera  Tube. 

quality  (Ref.  9). 

Schade  (Ref.  9)  has  proposed  the  noise  equivalent  bandwidth, 

N  ,  as  a  summary  measure  of  quality  where 

Since  R^(N)  has  a  maximum  value  of  oue  at  ^.ero  frequency  (for  a  linear 
system)  and  falls  off  with  frequency,  Schade 's  measure  weighs  the 
low  frequency  response  more  heavily  than  Eq.  (17I).  The  equivalent 
and  noise  equivalent  bandwidths  are  shown  for  a  typical  MTF  in  Fig.  99. 

Another  figure  of  merit  that  has  been  extensively  used  is  the 
acutance  of  ui  jmage  (Ref.  10).  The  amtance  is  obtained  ip  the 
following  mani.'er.  A  sensitive  surface  is  partially  covered  with  a  knife 


Fig.}.OC  Output  Waveshape  ( - )  for  a  Step  Function  Input  ( - ). 

Slope  of  Output  Waveshape,  Ag^/Ax^  is  used  to  Find  Image 
Aoutance . 

edge  and  exposed  to  light .  The  light  in  the  illuminated  area  does 
not  stop  at  the  knife  edge  but  is  diffused  into  the  shielded  region  by 
reason  of  reflection,  refraction,  diffraction  and  scattering  vdthin  the 
sui’face.  Thus,  the  distribution  of  photoelectrons  generated  (or  density 
of  exposed  graiJis  in  a  photograph)  instead  being  a  step  function 
assumes  the  typical  S  shape  shovm  in  Fig.  300,  The  slope  of  the  S-shaped 
curve  at  any  point  is  Ag(x. )/Ax^.  The  slope  is  deteimined  for  every 
position  on  the  curve  at  equally  spaced  increments  Ax^  and  summed  to 
give  the  expression 

=  I;(Ag./Ax^)^/n  ,  (175) 

where  n  is  the  total  nui-'ler  of  Ax  increments.  The  acutance  is  defined 
as 
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Acutance 


(176) 


vrtiere  I  is  the  magnitude  of  the  step  in  exposure.  Aoutance  has  been  found 
s 

to  correlate  vdth  Image  sharpness. 

Acutance  bears  a  strong  resemblance  to  Schade's  Nq.  The 
derivative  of  the  unit  step  function  r__^(x)  is  the  Impulse  response 

i.e.. 


Ar_i(x^) 


(177) 


[Ar_i(x^)]" 


n  r/(x)dx  j 


(178) 


and  by  Parstval's  theorem. 


=  Sq\  f^o^(N)ldN  = 


(179) 


as  can  be  seen  Ng  is  equivalent  to,  if  not  exactly  the  same  as 
acutance. 

Hufnagel  (Ref.  9)  evalviated  4  measures  consisting  of  the 
one  and  two  dimensional  forms  of  and  He  notes  that  none  of 


the  functions  meet  his  test  for  a  measure  “that  is  not  invalid." 

(Hufhagel  rates  a  measure  "not  invalid"  if  the  objective  vs  subjective 

rankings  of  image  qualify  plot  as  a  rising  straight  line.)  However, 

he  claims  the  best  results  for  the  Strehl  measure  for  photographs  with 

substantially  zero  grain.  For  photographs  with  grain,  he  found  a 
2 

quantity  where 
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which  he  dubs  a  grain  modified  Strehl  measure.  The  above  equation  hgiS 
the  form  of  a  sJ^al-to-noise  ratio  for  an  aperiodic  image. 

Most  of  the  work  in  defining  picture  quality  measures  has 
been  performed  using  photographs,  'ilie  xisual  procedure  is  to  make  photo¬ 
graphs  with  lenses  of  different  MTF's  (but  MTF's  which  are  similar  in  shape). 
Observers  are  asked  to  grade  the  resvating  pictures  in  order  of  "quality.." 

It  is  not  surpri.sing  that  the  pictures  taken  with  the  lenses  of  highest 
MTF  {roved  to  be  the  best  or  that  the  integral  of  the  highest  MTF 
(whether  squared  or  not)  has  the  laigest  numerical  value. 

A.  measure  based  on  ^ITF  alone  applies  only  when  the  image,  and 
the  eye  observing  the  image,  is  completely  noiseless.  Note  also,  that 
it  may  be  necessary  to  include  the  observer's  MTF  in  certain  image 
quality  determinations  even  if  the  noise  is  essentially  negligible. 

However,  no  photoconversion  process  is  completely  noise-free  and  under 
many  conditions,  picture  quality  may  be  primarily  limited  by  noise 
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rather  than  ITTF .  Indeed,  much  of  the  apparent  lack  of  straight  line 
correlation  between  image  quality  and  a  summary  measure  based  on  MTF 
alone  may  be  due  to  the  neglect  of  the  noise. 

In  any  event  there  is  a  growing  belief  that  a  summary 
measure  of  image  quality  must  be  based  on  signal-to-noise  ratio  and 
efforts  in  this  direction  are  being  made. 

6.2  Signal-to-Noise  Ratio  Related  Image  Quality  Parameters 

As  a  first  step  in  defining  an  image  quality  measure  based 
cn  signal-to-noise  ratio,  Siiyder  (Ref.  9)  has  proposed  that  the  measure 
be  the  integral  of  the  display  signal-to-noise  ratio  above  the 
observer's  threshold  (SNRjj.p)  as  illustrated  in  Fig.  101.  The  solid 

curves  represent  the  image  signal-to-noise  ratio  obtainable  from  the 
sensor's  display  at  two  different  light  levels  and  the  dashed  curve 
represents  the  observer's  threshold  signal-to-noise  ratio  requirement. 
The  area  is  that  between  a  given  solia  line  and  the  dashed  line. 
Mathematically,  the  enclosed  SNR^  area,  called  the  MTF^  is  given  by 


“^A  =  /o*  CSNRpCN)  -  SNRjjj,(N)]  dH  . 


(181) 


SNRjj,  for  periodic  bar  patterns,  is  proportional  to  Rgp(N)  the  square 
wave  flux  response  and  is  inversely  proportional  to  N,  the  spatial  fre¬ 
quency,  i.e., 

,  (182; 
as  N  approaches  zero,  SNR^  approaches  infinity.  Ihren  at  low  N,  SNR^ 
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Fig.  101  Display  Signal-to-JJoise  Ratio  Obtainable  ( - )  and  Required 


/ispia^ 


for  Two  Light  Levels  as  a  Function  of  Spatial  Frequency. 
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becomeo  very  large.  However,  the  also  Increases  at  low  spatial 

frequencies  and  thus  integral  of  Eq.  (181)  should  have  a  finite  value. 

MTF  is,  of  course,  a  function  of  the  observer  viewing  distance  since 
viewing  distance  Influences  the  lowest  spatial  frequency  observable. 

MTF^,  generally  weighs  low  spatial  frequency  response  even 
more  heavily  than  does  N  and  the  heavy  weight  of  N  on  low 
frequency  response  has  been  one  of  the  major  criticisms  of  N  . 

Schade  (Ref.  k)  also  notes  that  while  generally  a  val’.d  guide  for 
systems  with  similar  MTF's  and  noise  characuoristics  is  inappropriate  for 
systems  vdth  dissimilar  characteristics.  In  Schade 's  new  measure, 
the  balanced  threshold  resolution  becomes  the  image  quality  criterion. 

By  balanced  resolution,  Schade  means  the  average  of  resolution  cal- 
caulated  for  periodic  and  aperiodic  test  patterns.  Since  periodic  pattern 

detection  weighs  high  spatial  frequency  response  more  heavily,  the 
balanced  resolution  concept  wovild  presumably  remove  some  of  the  heavy 
low  spatial  frequency  response  bias  of  N^. 

The  goal  of  many  researchers  has  been  to  find  a  single 
unitary  measure  of  image  quality.  A.s  we  have  shown,  a  single  unitaiy 
measure  is  unlikely  because  of  the  dependence  of  image  quality  on  image 
exposure  and  on  loise.  Rather  than  a  single  unitary  measure,  a  function 
will  result .  It  is  agreed  that  the  function  should  be  based  on  image 
signal -to-noiss  ratio  but  that  integral  measures  such  as  MTF^  may 
not  result  in  the  most  useful  foi*m. 

We  currently  favor  the  threshold  resoluidon  approach.  An 
image  quality  measure  such  as  MTF^  may  show  the  relative  "goodness"  of  two 
systems  but  the  meas’U'e  cannot  be  used  to  predict  system  performance  in 


the  field.  Threshold  resolution  incorporates  all  of  the  system  parameters 
including  image  e:q)osure  time,  light  level,  image  stability,  sensi¬ 
tivity,  photoconversion  noise,  system  generat.ed  noises,  MTF  and  etc. 

Also,  it  can  be  used  directly  to  estimate  field  performance  —  at  least 
on  a  first  cut  basis.  The  previous  complaint  was  that  threshold  resolu¬ 
tion  only  applied  to  periodic  bar  patterns.  The  balanced  resolution 
concept  wiiich  has  been  discussed  at  some  length  in  Section  2  circumvents 
this  difficulty  since  it  includes  aperiodic  objects.  However,  the  method 
of  weighing  the  aperiodic  and  periodic  resolutions  remain  as  an  issue. 

We  note  that  Schade's  balanced  resolution  concept  includes  dynamic  range 
(grey  shades)  vdiich  has  not  been  included  in  the  discussian  of  Section  2. 
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